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ABSTRACT 


In  undertaking  the  development  and  acquisition 
of  improved  training,  testing  and  evaluation  (TT&E) 
equipment/facilities,  it  is  essential  that  the 
starting  point,  incremental  growth,  and  the  funda- 
mental technical  precepts  be  established  and  under- 
stood from  the  onset.  This  document  identifies  and 
discusses  each  of  those  considerations  which  tran- 
scend the  major  elements'  of  the  overall  improvement 
program  and  the  efforts  necessary  to  obtain  the 
highest  priority  capabilities  summarized  in  the 
companion  document,  "Requirements  Analysis  for 
Improvement  of  USAF  OTT&E,"  2FTP  - H0386002.  The 
contents  will  both  document  the  basis  for  courses 
chosen  and  serve  as  a considerations  guide  for 
future  improvement  programs.  The  systems  engineer- 
ing and  management  approaches  in  use  should  assure 
a balanced  treatment  of  all  requirements  and  dis- 
ciplines in  the  extensive  trade-offs  needed  to  satisfy 
budget  constraints  as  set  forth  in  another  companion 
volume,  "Guide  for  Improvement  of  USAF  OTT&E,"  2FTP  - 
H0386001. 
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SECTION  1 

GENERAL  CONSIDERATIONS 


1.1  PROGRAM  CONSIDERATIONS 


The  objective  of  the  TT&E  Improvement  Program  is 
to  establish  a continuing  integrated  program  to  improve 
the  testing/training  capabilities  at  existing  USAF 
air-to-ground,  air-to-air,  and  radar  bomb  scoring  sites 
and  ranges.  As  this  is  envisioned  to  be  a continuing 
program  over  an  extended  time  frame,  the  technical 
approach  requires  an  evolutionary  development  and  acquisition 
process  at  each  stage  of  capability  increase  to  avoid 
scrapping  existing  capabilities  as  new  capabilities  are 
added. 

1 . 2  OPERATIONAL  CONCEPT 


Each  Air  Force  range  or  site  has  unique  character- 
istics, limitations,  requirements  and  missions.  There- 
fore, separate  operational  concepts  are  needed  for 
each  range  that  requires  improvements.  Current  range/ 
site  owners  will  continue  to  operate  and  maintain  their 
facilities  throughout  the  improvement  cycle.  Range 
improvement  equipment  should  be  turned  over  to  the  range 
owner  after  the  required  integration  and  testing  has 
been  completed.  Normally,  the  range  owners/operators 
provide  the  necessary  interface  with  other  local 
airspace,  land  and  frequency  spectrum  users. 

1.3  DEVELOPMENT  AND  ACQUISITION  APPROACH 


The  approach  is  a careful  application  of  established 
procedures  and  disciplines  to  major  phases  of  effort: 
requirements,  design,  fabrication,  installation,  and 
checkout  test  and  evaluation  to  validate/confirm/verify 
the  system  capability  and  identify  limitations.  The 
requirements  are  established  in  a broad  sense  by  the 
operating  and  using  commands  and  are  defined  in  more 
specific  detail  through  mission  analyses  by  both  the 
developer  and  operator/users. 
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Validation  of  the  operational  requirements  occurs  prior 
to  issuance  of  the.  directive  to  proceed.  The  companion 
document  2FTP  - H0386002  has  been  developed  after  con- 
siderable interface  with  the  range  operators/users. 

This  family  or  class  of  requirements  should  be  validated 
by  USAF  so  specific  items  of  equipment  may  be  programmed 
and  procured  annually  as  the  budget  will  allow.  After 
validation,  the  engineering  definition  and  trades  should 
be  well  along  before  initiation  of  procurement  actions. 
Solutions  should  be  selected  in  the  following  order  of 
precedence;  Existing  systems  and  equipment,  existing 
designs,  programmed  systems  and  equipment  and  develop- 
ments based  on  the  state-of-the-art  technology. 

1.4  SYSTEM  ENGINEERING 


From  the  general  and  specific  directives  and  detailed 
mission  analyses,  requirements  can  be  derived  to  serve 
as  inputs  to  the  performance  specifications  needed 
for  the  procurement  of  hardware/software.  For  acquisi- 
tion purposes,  the  TT&E  Improvement  Program  can  be 
conveniently  divided  into  six  hardware-oriented  areas  or 
segments.  These  are; 

a.  Simulated  Enemy  Threats. 


b.  Targets. 

c.  Instrumentation. 


d.  Command  and  Control. 


e.  Communications. 

f.  Range  Support  Facilities. 


For  procurement  purposes,  a series  of  specifications 
will  be  required  for; 


a. 

TT&E 

Improvement  Systems 

b. 

TT&E 

Segments. 

c. 

TT&E 

Interfaces , 

d. 

TT&E 

End  Items, 
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During  development  and  acquisition,  formal  design  and 
configuration  reviews  are  necessary  to  insure  progress 
and  achievement  of  performance  and  functional  objectives. 
Figure  1-1  illustrates  the  system  engineering  flow  pro- 
cess. 

1.5  VALIDATION/VERIFICATIQN/LIMITATION 

Included  in  the  acquisition  process  is  a series  of 
equipment  and  systems  tests  needed  to  assure  that  objec- 
tives are  achieved  in  terms  of  capability  as  well  as 
the  definition  of  limitations.  Test  responsibilities 
must  be  defined  in  specific  test  objective  documents  for 
each  segment,  system  or  end  item.  To  assure  achieve- 
ment of  the  range  capability  sought,  the  operator  will 
normally  participate  in  the  final  DT&E/IOT&E  to  establish 
satisif action  of  the  Government  prior  to  the  system 
being  declared  ready  for  turnover  and  transition.  With 
these  processes  described  in  detail  elsewhere,  this 
document  concentrates  on  a detailed  technical  approach 
for  the  program.  Figure  1-2  shows  the  validation/ 
verification/limitation  flow  of  a system. 

1.6  SUMMARY 

Section  2,  "Basic  Evaluation  Concepts,"  presents 
basic  evaluation  concepts  and  provides  rationale  for  the 
Training,  Testing  and  Evaluation  (TT&E)  Improvement 
Program.  The  process  of  translating  operational  require- 
ments into  instrumentation  requirements  is  also  dis- 
cussed. 

Section  3,  "Training,  Testing  and  Evaluation 
Improvement  Process"  presents  the  objectives  of  the 
Training,  Testing  and  Evaluation  Improvement  Program, 
the  operational  characteristics  common  to  all  ranges 
selected  for  improvements,  and  a description  of  the 
improvement  program  segments. 

Section  4,  "Technical  Considerations,"  provide 
a detailed  technical  description  of  the  particular 
techniques,  procedures,  and  equipment  required  to  pro- 
vide improved  TT&E  capabilities. 

The  planning  reflected  by  this  document  is  based  on 
the  following; 
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SIMPLIFIED  SYSTEMS  ENGINEERING 


FIGURE  1- 


Figure 


a.  The  stated  objectives  and  priorities  of 
existing  directives  to  improve  USAF  Training,  Testing 
and  Evaluation . 

b.  Requirements  set  forth  in  "Requirements 
Analysis  for  Improvement  of  USAF  OTT&E,"  2PTP  -H0386002. 

c.  Review  and  analysis  of  the  real-world,  time- 
phased  threat  situation  presented  in  the  related  document, 
"Intelligence  Considerations  for  Improvement  of  USAF 
OTT&E/'  2PTP  - H0386004. 

d.  Established  operational,  technical  and  sup- 
port constraints,  plus  the  "Design  to  Constraints  of 
Budget,  Cost,  or  Life  Cycle  Cost." 
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SECTION  2 

BASIC  EVALUATION  CONCEPTS 


2.1  PERFORMANCE  MEASURES 


A fundamental  ingredient  of  military  test  and  train- 
ing operations  is  to  obtain  quantitative  indicators  of 
"performance,"  in  terms  which  are  sensitive  enough  to 
detect  meaningful  differences  in  performance  among 
competing  equipments  or  alternative  tactics.  However, 
"perfomance"  is  difficult  to  quantify  in  operational 
terms.  For  example,  an  instriamentation  device  cannot 
directly  measure  "suitability,,"  "effectiveness,"  "ade- 
quacy," "survivability,"  etc.,  since  these  are  basically 
qualitative  terms.  Instrumentation  can,  however, 
measure  physical  quantities  (such  as  position,  velocity, 
acceleration,  event  timing,  error  values,  antenna  gain, 
etc.).  These  physical  measurements  may  be  summarized  by 
statistical  or  mathematical  descriptors  (such  as  mean 
time  between  failures,  circular  error  probability, 
side-lobe  ratio,  etc.).  These  in  turn  may  be  used 
directly  or  via  mathematical  models  to  project  cor- 
responding descriptors  under  operational  conditions, 
which  can  provide  the  basis  for  judgments  concerning 
suitability,  adequacy,  etc.  Because  effectiveness  per 
se  cannot  be  measured,  it  is  necessary  to  decide  upon  a 
set  of  measurable  quantities  (or  summarizers  of  them) 
which  can  give  a quantitative  character  to  "effective- 
ness." Some  of  the  ingredients  involved  in  the  effective- 
ness assessment  are  shown  in  Figure  2-1. 

The  problem  of  selecting  a set  of  useful  measurable 
quantities  which  also  satisfy  the  conditions  of  sensi- 
tivity and  operational  pertinence  becomes  especially 
acute  when  "performance"  judgements  are  required  with 
respect  to  multiple  participants  in  a two-sided  encounter. 
Figure  2-2  identifies  some  of  the  numerous  potential 
crew  errors  in  a multiple  participant  situation  which 
can  influence  a mission's  effectiveness.  In  particular, 
there  is  an  understandable  hesitance  to  judge  performance 
from  the  same  set  of  measurable  quantities  which  have 
been  used  as  a basis  for  judgments  in  simpler  (one-on-one) 
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situations.  This  hesitancy  is  in  some  sense  attributable 
to  the  large  number  of  descriptors  which  the  evaluator 
would  be  required  to  assimilate  and  weigh  in  coming 
to  a judgment,  but  the  major  source  of  concern  is  a 
sense  of  the  inappropriateness  of  such  extension  to 
multiple-participant  encounters.  This  vineasiness  is 
even  more  pronounced  when  the  evaluator  must  infer 
what  would  happen  in  a multiple  participant  encounter 
on  the  basis  of  data  taken  in  a one-on-one  test,  and 
often  mamifests  itself  in  the  form  of  a special  mis- 
trust of  mathematical  models  or  simulators  which 
attempt  to  accomplish  such  extensions  and  projections. 

Bypassing  these  problems  and  examining  the  end 
results  of  a conflict,  "performance”  can  be  character- 
ized in  terms  of  the  number  of  casualties  (or  survivors) 
in  a military  encounter.  It  is  informative  to  measure 
"casualties"  in  units  of  equipment  Caircraft,  SAM  sites, 
primary  targets)  rather  than  personnel.  Such  a des- 
criptor certainly  possesses  the  attributes  of  quantif iability , 
sensitivity,  and  pertinence.  It  also  has  merit  as  an 
absolute  measure  of  readily  xmderstandable  significance, 
in  addition  to  its  obvious  utility  as  a relative  measure, 
or  discriminator,  among  alternatives.  However,  its 
greatest  appeal  lies  in  its  unversality:  "VThat  is  the 

value  of  this  new  training  method?  Of  this  new  jammer? 

Or  this  new  tactic?  Or  this  nevr  airplane?"  Can  all  be 
answered  by  showing  how  aircraft  losses  were  lessened, 
while  accomplishing  the  same  mission,  as  compred  to  the 
old  training  method,  jammer,  tactic,  or  airplane? 

Such  an  attractive  scheme  for  characterizing  per- 
formance does  not  come  easily.  As  might  be  expected, 
there  are  important  prices  to  be  paid  (not  only  in 
monetairy  terms)  in  order  to  attain  this  goal.  One  of 
the  most  irapcrtant  ways  in  which  the  cost  is  expressed 
is  in  the  critical  importance  of  realism  as  a necessary 
ingredient  of  the  test  situation.  Realism  of  replica- 
tions of  enemy  equipment,  command  and  control  structure, 
employment  doctrine  and  tactics,  as  well  as  the  cor- 
responding aspects  of  the  friendly  forces  attacking 
or  penetrating  this  defensive  network  is  of  key 
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importance;  since  one  of  the  major  justifications 
for  the  "end  result"  type  of  performance  measure 
is  mistrust  of  complex  mathematical  models.  An 
especially  important  aspect  of  necessary  realism  is  the 
provision  for  the  nearly  instantaneous  "removal"  (by 
procedural  means)  of  "killed"  participants  from  the 
encounter,  because  their  unrealistic  continued  par- 
ticipation, even  for  very  short  intervals,  could 
wrongly  affect  the  end  result. 

However,  a "safe"  war  game  is  unrealistic  in  some 
basic  and  irremediable  ways.  Because  lethal  weapons 
cannot  actually  be  fired  in  two-sided  encovmters 
involving  human  participants,  there  can  be  no  oppor- 
tunity to  react  to  the  sensing  of  actual  missile 
trajectories  in  real  time.  For  example,  there  can  be 
no  aircrew  reaction  to  a surface-to-air  missile  in 
flight  by  virtue  of  continued  visual  contact,  which 
could  be  important  for  controlling  evasive  maneuvers, 
when  such  a missile  is  "flying"  only  internally  in  a 
computer  mathematical  simulation.  On  the  defensive 
side,  there  will  be  no  opportunity  for  a defensive 
radar  crew  to  detect  that  a simulated  anti-radar 
missile  has  been  launched  against  it,  requiring  suitable 
counteraction,  such  as  shutting  down  the  radar  and/or 
activating  a decoy.  Because  training/test  ranges  must 
necessarily  exploit  sparsely  inhabited  areas  sometimes 
referred  to  as  wasteland,  the  defensive  systems  cannot 
be  realistically  deployed  in  and  around  industrial  and 
metropolitan  centers  as  would  normally  be  the  case. 

However,  in  full  awareness  of  the  limitations 
and  risks  attending  these  concepts,  such  methods  for 
characterizing  performance  in  complex,  multiple- 
participant  engagements  are  so  superior  to  any  other 
alternative  which  can  be  posed,  that  implementation 
on  certain  Air  Force  test/training  ranges  is  clearly 
desirable. 

A problem  of  a different  sort  is  presented 
with  respect  to  the  necessary  time-phased  imple- 
mentation of  TT&E  improvements.  While  an  argument 
can  be  presented  for  the  value  of  a "realistic" 
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enemy  threat  deployment  alone  as  a vehicle  for 
training,  the  complete  characterization  of  the 
results  of  encounters  between  such  an  environment 
and  multiple  penetrators  in  terms  of  the  casualties 
or  survivors  will  not  be  achieved  in  the  near 
future.  This,  then  raises  the  reasonable  question, 

"Is  there  a sensible  half-way  point  for  TT&E  improve- 
ments, which  provides  a utility  commensurate  vjith 
its  investment,  short  of  a completely  credible 
simulation  of  equipment  guidance,  fuzing,  warhead 
lethality,  and  aircraft  vulnerability  necessary  for 
believable  "kills"  in  real  time?" 

The  answer  to  this  question  must  come  from  the 
development  of  less  sophisticated  performance  des- 
criptors which  can  be  supported  by  instrumentation 
and  scoring  techniques  which  can  be  made  available 
in  the  near  future.  The  practical  necessity  for  these 
performance  descriptors  in  the  intermediate  phases 
adds  urgency  to  the  current  effort  to  survey  the 
potential  needs  of  range  operators  and  users  in  these 
early  time  frames,  and  translate  those  needs  into 
acceptable  (if  not  ideal)  performance  measures  of 
utility. 

2.2  INTERPRETATION  OF  OPERATIONAL  REQUIREMENTS 


None  of  the  guidance  and  directive  documents  for 
the  TT&E  Improvement  Program  furnish  a solid  support- 
ing rationale  to  show  how  the  detailed  requirements 
for  values  to  be  measured  and  their  accuracies  are 
derived  from  the  statements  of  broad  mission  categories 
or  types  of  training/testing  to  be  supported.  In 
particular,  there  is  no  indication  of  "performance 
measures"  or  "performance  descriptors"  which  will 
ch,aracterize  how  well  a training  mission,  test,  air- 
to-air  encounter,  etc.,  is  accomplished.  The  "casualty 
list"  performance  descriptor  discussed  in  paragraph 
2.1  above  is  not  explicitly  identified  as  a goal  for 
TT&E  improvements.  However,  the  capability  to  evaluate 
the  vjorth  of  a particular  piece  of  equipment  or  tactic 
employed  against  any  portion  of  a realistic  environment 
is  enhanced  by  the  ability  to  perform  real  time  casualty 
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assessments.  Meanwhile,  before  this  capability  can  be 
implemented,  a logical  structure  which  has  as  its 
central  theme  a set  of  performance  descriptors  will  be 
developed.  This  structure  of  performance  measures  is 
not  viewed  as  an  abstract  exercise,  but  as  the  central 
element  of  a necessary  formal  justification  for  the 
investment  in  particular  items  of  hardware,  and  as  a 
basis  for  a "systems  approach"  to  the  stage-by-stage 
growth  of  TT&E  improvements.  The  formulation  of  this 
set  of  specific  performance  descriptors  and  coordina- 
tion with  range  operators/users  with  respect  to  the 
value  of  such  descriptors  in  characterizing  performance 
for  specific  test  or  training  missions  can  provide 
the  vehicle  for  assessing  the  utility  of  TT&E  improve- 
ments to  range  users,  and  will  furnish  an  organized 
basis  for  decisions  on  funding  and  schedule  which 
impact  that  utility. 

To  give  an  example,  electronic  warfare  effective- 
ness can  be  characterized  by  a descriptor  such  as  the 
ratio  of  total  defense  tracking  time  (by  fire  control 
AAA  radars  or  SAM  radars)  to  the  total  exposure  time 
of  the  attackers  to  these  radars.  Obviously,  the  terms 
"tracking"  and  "exposure"  require  precise  definition. 

Some'  systems  have  a lock-on  relay  which  could  define 
tracking  time  electrically  and  unambiguously.  Exposure 
can  be  defined  with  respect  to  the  engagement  volume  of 
the  defensive  weapons  and  specified  geometrically.  The 
specific  items  of  data  needed  to  permit  the  calculation 
of  this  proposed  performance  descriptor  are; 

a.  The  time  of  closing  and  opening  of  the 
lock-on  relay  (or  equivalent  events  for  all  defensive 
fire  control  and  SAM  guidcince  radars)  . 

b.  Times  of  entry  and  exit  of  the  specified 
engagement  volumes. 

The  second  set  of  data  items  implies  a requirement 
for  a knowledge  of  the  time/position  history  of  participating 
aircraft,  so  that  the  times  of  crossing  the  geometric 
boundaries  of  the  engagement  region  of  the  defensive 


weapons  can  be  determined.  Such  a performance  measure 
is  certainly  achievable  with  the  kinds  of  equipment 
available  today.  It  is  quantitative,  reasonably 
sensitive  to  changes  in  electronic  warfare  equipment 
and  tactics,  and  is  pertinent,  at  least  for  noise 
jamming.  It  would  not  be  pertinent  (nor  sensitive, 
probably)  to  various  types  of  deception  jamming.  In 
such  cases,  other  descriptors  would  be  necessary  to 
indicate  "how  well"  the  deception  worked.  Recog- 
nizing such  limitations  the  question  to  resolve  be- 
comes, "Is  this  postulated  performance  measure  (i.e., 
the  ratio  of  track  time  to  exposure  time)  sufficiently 
useful  for  some  test  or  class  of  tests  which  has  been 
programmed  for  the  near-term  period  to  warrant  its 
implementation  (i.e.,  the  acquisition  of  the  instru- 
ments required  to  measure  and  record  the  data  items 
necessary  for  the  calculation  of  that  performance 
descriptor)?"  If  coordination  with  users  results  in  an 
affirmative  answer,  acquisition  of  the  necessary 
equipment  is  tied  directly  to  a needed  capability 
expressed  in  terms  of  measurements  necessary  to  des- 
cribe performance. 

The  example  given  above  is  overly  simplistic. 
However,  such  a technique  permits  the  translation  of 
broad  and  general  statements  of  requirements  into 
specific  questions  concerning  the  particular  elements 
of  data  which  are  needed  to  describe  performance. 

From  the  necessary  data  elements,  the  specification  of 
instrumentation  to  measure  and  acquire  them  can  follow 
in  a straight-forward  manner. 

Ideally,  the  specification  of  measurement  devices 
should  be  preceded  by  the  framing  of  questions  regard- 
ing requirements  by  the  specific  and  organized  way 
described  above,  and  by  the  coordination  cycle  with 
range  operators/users  including  the  consolidation  of 
an  "agreed"  list  of  performance  descriptors  and  the 
data  items  required  or  implied  by  them.  Necessarily, 
some  estimates  based,  on  experience  must  be  used  to 
pose  an  initial  framework  for  the  specification  and 
selection  of  hardvjare,  in  order  that  this  planning 
for  equipment  acquisition  can  proceed  in  parallel  with 


the  performance-measure  definition  processs  described 
above.  This  emphasizes  the  urgency  of  the  detailed 
requirements-refinement  process  during  development, 
acquisition  and  use.  As  the  requirements  evolve  with 
the  application  of  new  systems,  weapons  and  tactics, 
the  older  methods  of  TT&E  will,  in  many  areas,  become 
less  adequate.  In  fact  the  TT&E  needs  of  new  systems 
should  be  an  inherent  part  of  those  systems,  developed 
concurrently  instead  of  with  today's  separate  and  often 
uncoordinated  development. 
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SECTION  3 

TRAINING,  TEST  AND  EVALUATION 

IMPROVEIvEKT  PROCESS 


3 . 1 OPmTECTIVE 


The  primary  objective  of  a TT&E  improvement  effort 
is  to  establish  a continuing,  integrated  program  to  pro- 
vide improved  capabilities  for  conducting  training  and 
testing  operations  at  existing  USAF  air-to-ground,  air- 
to-air,  and  radar  bomb  scoring  sites  and  ranges. 

An  incremental  approach  should  be  employed,  making 
maximum  use  of  existing  systems  and  equipment,  and  so 
scheduled  as  to  maintain  continuity  of  range  operations 
as  the  continuous  improvement  proceeds. 

3 . 2 GENERAL  DESCRIPTION 

Although  specific  required  characteristics  and  -cap- 
abilities will  vary  with  the  function,  location,  and  size 
of  each  range,  the  primary  developmental  goals  common  to 
most  ranges/sites  include  the  following: 

a.  Low-cost  operation. 

b.  Maximum  combat  realism. 

c.  Rapid  and  accurate  data  reduction 
and  reporting. 

d.  Maximum  range  flexibility  and  equipment 
mobility  so  that  range  instrumentation  can  be  moved 
to  different  terrestial,  climatic>  or  operational 
locations. 


e.  Minimum  impact  on  operational  equipm.ent 
(modification,  etc.). 

f . A capability  to  integrate  more  than  one 
range  into  a netv/ork  to  facilitate  evaluation  of 
large  strike-size  test  and  training  missions. 
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To  some  degree  these  goals  are  contradictory  and 
their  interaction  will  bring  about  the  final  configuration 
at  each  range.  Funding,  geographic  and  environmental  con- 
straints apply  to  each  of  the  goals. 

In  any  event,  an  overriding  goal  is  the  provision  of 
a test  environment  in  terms  of  equipment,  people,  and 
procedures  which  will  make  the  tests  highly  credible  to 
the  users  and  build  confidence  in  the  test  results.  Some 
of  the  factors  contributing  to  these  desired  ends  are 
given  in  the  Figure  3-1. 

3.3  TT&E  SEGMENTS 

TT&E  improvements  must  be  implemented  in  discrete, 
functionally- interconnected  segments.  While  some  reuiges 
may  receive  improvements  in  each  segment,  most  improve- 
ments on  a given  range  will  address  only  selected 
segments.  The  six  segments  are  illustrated  in  Figure 
3-2  and  a description  of  each  of  the  segments  follows: 

3.3.1  Simulated  Enemy  Threat 

The  threat  segment  consists  of  equipment  designed 
to  simulate  enemy  force  dispositions;  SAM/AAA,  early 
warning  and  acquisition  radars,  ECM  and  IFF  systems, 
and  command,  control  and  communication  systems. 

3.3.2  Targets 

This  segment  consists  of  ground  fixed,  ground  mobile, 
and  airborne  targets  representative  of  enemy  equip- 
ment. Integration  of  targets  with  scoring  systems  is  an 
objective  for  this  segment. 

3.3.3  Instrumentation 

This  segment  includes  much  of  the  electronic  data 
acquisition  equipment  such  as; 

a.  Time-Space-Position  Information  (TSPI) . Effort 
in  this  area  should  include  emphasis  on  development/ 
acquisition  of  systems  for  range/mission  control,  safety 
and  scoring.  It  includes  conventional  radar,  optics, 
and  laser  systems.  It  also  includes  multilateration 
systems  such  as  ACMI  and  RMS/SCORE. 
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(1)  Air  Combat  Maneuvering  Instrvimentation 
CACMI)  . This  instriomentation  provides  a capability 
for  tracking  and  display  of  all  participants  in  an 
air-to-air  engagement,  with  sufficient  accuracy  and  data 
rate  to  allow  evaluation  of  the  maneuvers  performed,  and 
scoring  of  the  engagement. 

(2)  RMS-II/SCOKE.  Provides  essentially  the 
same  capability  as  ACMI  above. 

(3)  Conventional  Radar,  Optics,  Lasers.  TSPI 
instrumentation  to  provide  data  for  control,  safety , 
and  scoring. 

b.  Scoring.  Instrumentation  is  required  for 
live  and  simulated  scoring  of  missiles,  rockets,  guns, 
bopibs,  and  electronic  warfare. 

(1)  Simulated  Scoring.  This  includes  equip- 
ment and  techniques  for  scoring  of  simulated  releases 
and  lauiiches  of  munitions. 

(2)  Actual  Scoring.  For  those  ranges  where 
actual  munitioni  (Bomb/Rocket/Strafe ) or  training 
munitions  can  be  expended,  the  goal  is  to  provide 
suitable  scoring  systems  for  delivery  evaluation  and 
impact  determination. 

(3)  Electronic  Warfare  (EW)  Scoring.  This 
includes  a family  of  equipment  and  techniques  used  to 
evaluate  the  effectiveness  of  electronic  warfare. 

3.3.4  Command  and  Control 


This  segment  involves  such  functions  as  general  air 
traffic  surveillance,  mission  scheduling,  range  safety, 
radio  frequency  monitoring  and  management,  and  similar 
matters. 


3.3.5  Communications 

This  segment  involves  the  radio,  wire,  and  other 
means  for  transmission  of  range  coramand/control , data, 
and  miscellaneous  other  communications  from  point  to 
point  on  the  range  including  the  vehicles  used  in  the 
OTT&E  missions. 
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3.3.6  Range  Support  Equipment 

This  segment  includes  such  items  as  data  pro- 
cessing and  recording  equipment,  displays,  standard 
pods,  primary  power  supply,  range  peculiar  support 
equipment,  and  support  facilities. 

3.4  CURRENT  RANGE  CAPABILITIES  AND  IMPROVEMENT  PLAN 


As  the  TTScE  Improvement  Program  progresses,  separate 
schedules  for  each  RBS  site  and  range  selected  for 
improvement  based  on  requirements  identified  should  be 
added  as  appropriate.  Each  schedule  should  summarize 
the  mission  of  the  range,  present  a description  of 
current  capability,  list  current  range  equipment,  and 
give  the  range  improvement  plan  for  each  applicable 
segment.  A listing  of  OTT&E  Ranges  to  which  such  an 
improvement  effort  could  be  applied  is; 

a.  Air  Force  Land  Ranges 


Avon  Park  FL 
Badlands  SD 
Blair  Lake  AK 
Cl airborne  LA 
Cuddeback  Lake  CA 
Dade  County  NC 
Edwards  AFB  CA 
Eglin  AFB  FL 
Luke  AFB  AZ 


Matagorda  TX 

Melrose  NM 

Nellis  NV 

Pointsett  SC 

Saylor  Creek  ID 

Smoky  Hill  KS 

Wendover-Hill  Complex  UT 


b.  Overwater  Ranges 


Eastern  Test  FL 
Gulf  Test  FL 
Gulfport  MS 
Lake  Superior  MN 
Matagorda  TX 
Myrtle  Beach  SC 


Nantucket  Shoals  MA 
Oswego  NY 
Savannah  GA 
Syeboygan  WI 
Upper  Lake  Huron  MI 
Western  Test  CA 


c.  Air  Force  Reserve/Air  National  Guard  Land 

Ranges 


Camp  Atterbury  IN 
Camp  Grayling  MI 
Camp  Shelby  MS 
Fort  Carson  CO 
Fort  Drum  NY 


Fort  Chaffee  AR 
Fort  Sill  OK 
McMullen  TX 
Smoky  Hill  KS 
Volk  Field  WI 
Warren  Grove  NJ 
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d.  Army  Ranges  Used  by  USAF 

Dugway  UT 
Ft  Huachuca  AZ 
Leach  Lake  CA 
Oscura/Yonder  NM 
Peason  Ridge  LA 
Red  Ridge  NM 

e.  USAFE  Ranges 

Bardenas-Reales , Spain 

Baumholder,  Germany 

Cowden,  Great  Britain 

Dutch,  Off  Coast  of  Netherlands 

Helchtern,  Belgium 

Holbeach,  Great  Britain 

Ibisia,  Off  Coast  of  Spain 

Incirlik,  Off  Coast  of  Turkey 

Jurby,  Off  Coast  of  Great  Britain 

Konya,  Turkey 

Maniago,  Italy 

Otterburn,  Great  Britain 

Siegenburg,  Germany 

Suippes,  France 

Vliehor,  Netherlands 

Tain,  Scotland 

Tymbakion,  Crete 

Wainfleet,  Great  Britain 

f . PACAF  Ranges 

Chandy  (Thai  operated) , Thailand 
Crow  Valley,  Philippines 
F.S.  (Chinese  operated) , Taiwan 
Idensuna  Jima  Island,  OJcinawa 
IE  Shima,  Okinawa 
KoonNI,  Korea 

Nightmare  (ROK  controlled) , Korea 

Shui  Chi  (Chinese  operated) , Taiwan 

Tabones/LosFrailes  (USN  controlled) , Philippines 

Tiro  Shima,  Okinawa 

Udorn  (Thai  controlled) , Thailand 
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g.  Fixed  RBS  Sites 


& 


Anderson  AFB,  Guam 
As land  ME 
Bismarck  ND 
Fort  Drum  NY 
Hastings  NB 
Hawthorne  NV 
Holbrook  AZ 
La  Junta  CO 

Figures  3-3  and  3-4  show  the  range  locations. 

3.5  RED,  WHITE  AND  BLUE  FORCE  CONCEPT 
3.5.1  Blue  Force 


Matagorda  TX 
NKP,  Thailand 
Ramstein,  Germany 
Richmond  KY 
Statesboro  GA 
Ubon , Tha i 1 and 
Udorn , Tha i land 
Wilder  ID 


The  aircraft  weapons  or  other  elements  engaged  in 
attack,  penetration,  or  otherwise  interacting  with 
the  range  enemy  are  considered  the  Blue  Force.  Blue 
Force  or  range  user  elements  are  usually  provided  by  tlv;; 
range  user  who  in  most  cases  is  a force  temporarily 
deployed  to  a range  for  test  and/or  training. 

The  Blue  Force  consists  of  USAF  units  from  any  of 
the  operational  commands  conducting  training,  test,  or 
exercise  missions  on  a given  range/RBS  site.  The  types 
of  Blue  Force  aircraft  and  equipments  to  be  accommodated 
are  listed  in  Table  3,1. 

The  types  of  mission  support  required  for  the  Blue 
Forces  are: 


- Augmentation  of  Blue  Command,  Control,  and  Com" 
munications  (C3) , when  required, 

- Augmentation  of  Blue  Force  ground-based  opera- 
tional equipment  or  provision  of  sites  for  this  equipment. 

- Logistic  support  of  Blue  Force  elements,  when 
required. 


3.5.2  Red  Force 

Any  portion  of  a range  that  replicates  a hostile 
or  enemy  capability  either  functionally  or  by  physical 
simulation  is  considered  part  of  the  Red  Force.  This 
includes  the  threat  and  target  segments  and  any  ground 
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TABLE  3.1 


BLUE  FORCES 

TYPES  OF  AIRCPvAFT,  WEAPONS  AND  EW  DEVICES  TO  BE  ACCOMMODATED 


Aircraft  EW  Devices  Weapons 


F-4 

Jammers 

Guns 

F-5 

ALQ-71 

AIM- 4 

F-105 

ALQ-72 

AIM- 7 

F-111 

ALQ-87 

AIM-9 

F-15 

ALQ-94 

AIM- 5 4 

F-16 

ALQ-101 

A~6 

ALQ-105 

AGM-12 

A-7 

ALQ-117 

AGM-45 

A-10 

ALQ-119 

AGM-65 

A- 37 

ALQ-131 

AGM-69 

RF-4 

ALQ-135 

AGM-78 

0-2 

Chaff  or  Flare 

AIR-Z 

OV-10 

ALE- 2 

Gravity  Bombs 

E-3A 

ALE- 20 

Guided  Bombs 

C-130 

ALE-24 

Rockets 

C-141 

ALE- 2 8 

Mines 

Cluster  Bombs 

KC-135 

ALE- 2 9 

B-52 

ALE- 3 8 

E-1 

RPVs 

CH-53 

Receivers 

ALR-20 

F-106 

ALR-31 

F-102 

ALR-41 

FB-111 

ALR-48 

SR-71 

ALR-53 

E-4 

ALR-56 

C-7 

RKAW 

APR-35/36 

APS-109 

Expendable  j ammers 
Decoys 
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or  air  elements  that  have  been  assigned  a hostile  role 
for  a particular  test  or  exercise.  The  Red  Force  is 
generally  the  responsibility  of  the  range  owner/operator. 

3.5.3  White  Force 

That  part  of  a particular  range's  function/equip- 
ment dedicated  to  evaluation  of  Red/Blue  engagement 
is  the  White  Force.  This  includes  such  items  as  the 
instrumentation,  TSPI,  scoring,  EW  evaluation,  and  range 
support  segments  such  as  command,  control  and  safety. 

3.5.4  Relationships 

Figure  3-5  illustrates  some  of  the  relationships  of 
Red,  White  and  Blue  Forces  in  the  EW  scoring  aspect  of 
observations. 

3 . 6 RANGE  SAFETY 


The  commander  of  each  range  is  responsible  for  as- 
suring maximum  safety  (air  and  ground)  consistent  with 
operational  requirements  for  all  systems  including  air- 
craft, missiles  and  unmanned  airborne  vehicles  operating 
on  each  range  facility.  He  is  also  responsible  for  all 
such  vehicles  requiring  overland  flight  testing,  train- 
ing, or  evaluation  which  cannot  be  contained  within 
existing  range  boundaries  and  are  launched  either  from 
within  range  boundaries  or  for  flight  activity  into  the 
range. _ (Includes  cognizance  for  influences  upon  the 
natural  environment  and  non-participating  systems.) 

3.6.1  Safety  Constraints 

Specific  improvements  for  each  range  should  be 
designed  to  provide  the  capability  for  the  safe  con- 
duct of  testing  and  training  to  the  following  degree. 

a.  The  probability  of  damage  or  injury  to  non- 
participating  system  or  personnel  should  not  exceed 
5 X 10-6. 


b.  Participating  systems  or  personnel  should 
be  subjected  to  no  greater  probability  of  damage  or  in- 
jury than  5 x 10”6  per  missions.  This  criterion  should 
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SCORING 

(A  WHITE  FUNCTION) 
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figure  3-5 


be  satisfied  through  the  design  of  the  range  equipment, 
primarily  with  hardware/software  characteristics,  and 
secondarily  with  operating  procedures.  Analyses  and 
trade  studies  should  substantiate  a practical  combina- 
tion of  hardware/software/procedures  to  achieve  practical 
levels  of  safety. 

On  the  basis  of  the  above  criteria,  methods  and 
materials  for  the  continued  use  of  range  safety  per- 
sonnel must  be  provided.  These  are  to  be  used  for 
application  in  the  analysis  and  assessment  of  individial 
missions/projects  to  permit  day-to-day  trade-offs  as  to 
the  nature  and  philosophy  of  range  control  and  operation. 

3.6.2  Safety  Considerations 

Figure  3-6  was  developed  by  Starr,  a recognized 
authority  on  risk  analysis.  This  figure  portrays  both 
the  benefits  and  the  risks  (probability  of  fatality, 

Pf)  one  is  willing  to  take  in  a sart^iling  of  categories, 
Starr  theorizes  that  if  one  doubles  the  benefit,  a 
person  is  willing  to  take  eight  times  the  risk.  As 
shown  on  Figure  3-6,  there  is  a level  at  which  the  risk 
(probability  of  fatality)  is  too  great  for  volvintary 
participation.  Beyond  that  threshold,  the  participation 
is  on  an  involuntary  basis.  The  risk  associated  with 
the  role  of  an  experimental  test  pilot  is  great  but  the 
benefits  (monetary,  prestige,  personal  desires,  and 
others)  provide  sufficient  compensation  that  he  performs 
voluntarily. 

How  do  we  cope  with  the  forces  that  bear  on  the 
safety  problem?  First,  determine  what  hazards  exist 
then  by  analysis,  understand  the  cause  of  the  hazard, 
and  finally  treat  or  take  actions  to  influence  the 
cause.  We  must  accept  the  concept  of  risk  and  by  our 
own  actions  create  for  ourselves  acceptable  levels  of 
risk.  By  doing  this  we  can  design  acceptable  systems 
that  are  safe  at  minimum  costs.  Safety  aspects  can  be 
dealt  with  and  controlled  by  responsible  actions  instead 
of  controlling  system  design  and/or  performance. 

3.6.3  Cost  of  Safety 

Present  safety  statistics  are  based  upon  accidents 
per  thousand  hour  of  flight  time.  While  completely 
valid  from  an  operational  viewpoint,  such  a statistical 
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approach  does  not  present  a cost  basis  to  determine  the 
dollar  worth  of  safety  improvements.  Figure  3-7  shows 
the  average  dollar  loss  of  aircraft  by  type  per  flight 
hour  and  illustrates  that  the  predominate  range  users  - 
(a)  Attack,  (f)  Fighter,  (B)  Bomber  are  the  high  loss 
leaders.  Range  improvements  which  reduce  the  probability 
of  mishap  can  therefore  significantly  reduce  the  AP 
dollar  expenditure.  Safety  improvements  should  be 
considered  on  an  equivalent  basis  with  reliability  and 
maintainability  in  life  cycle  costing,  integrated  logis- 
tics, and  design  to  cost  guidelines.  To  implement  this 
concept,  revisions  are  in  work  to  AFR  127-8,  AFR  800-8, 
AFR  800-11,  AFP  800-7  and  DH  1-6  Design  Handbook. 

3.6.4  Safety  Directives,  Regulations/Guidelines 

Figure  3-8  outlines  the  pertinent  current  directives 
governing  safety.  It  portrays  the  directives  for  both 
the  operator  and  the  developer.  Although  these  direc- 
tives attempt  to  cover  all  aspects  of  safety,  sit- 
uations will  arise  where  innovative  and  creative  thinking 
are  needed  to  resolve  problems  not  directly  addressed. 
Both  the  developer  and  operator  must  be  ever  alert  to 
safety  problems  and  take  prompt  actions  to  define  and 
eliminate  the  cause. 
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SECTION  4 

TECHNICAL  CONSIDERATIONS 

4.1  INTRODUCTION 


The  TT&E  Improvement  Program  involves  a large  number 
of  ranges,  RBS  sites,  and  other  training  areas,  each  with 
unique  characteristics.  It  is  not  the  intent  here  to  pro- 
vide generalized  solutions  to  all  TT&E  improvement  pro- 
blems, Rather,  the  purpose  of  this  section  is  two  fold: 
first,  to  emphasize  the  process  by  which  TT&E  improvement 
may  best  be  accomplished,  and  second,  to  illuminate  the 
technical  aspects  of  TT&E  improvements  that  must  be  con- 
sidered. 

4.2  REQUIREMENTS  DEFINITION 

The  process  of  improving  OTT&E  must  be  based  on  an 
in-depth  realistic  evaluation  of  the  specific  requirements 
in  each  of  the  OTT&E  segments:  Threats,  Instrumentation, 

Communications,  Command/Control,  Targets,  and  Range  Sup- 
port Equipment.  The  basic  definition  of  the  requirement 
(Required  Operational  Capability/ROC)  should  mandatorily 
address  the  OTT&E  requirements.  If  this  is  done  in  the 
early  stages,  adequate  test  ajid  training  plans  can  be 
made  to  maximize  the  benefits  to  both  the  developer  and 
user.  Defining  these  requirements  for  a range/site  on 
which  OTT&E  of  weapon  systems  and  crews  can  be  performed 
involves  the  following  steps: 

a.  Assimilation  of  Air  Force  OTT&E  and  training 
requirements  documented  in  ROCs  (Required  Operating 
Capability  Statements) , studies  like  HAVE  EDGE  and  the 
sUSAF  CONUS  Range  Study,  transcripts  of  testimonies  at 
Congressional  hearings  by  DDR&E  officials  and  Air  Staff, 
intelligence  information  and  guidance  documents  for 
OTT&E  improverrents . 

b.  Periodic  surveys  conducted  by  writing  to  all 
Air  Force  Commands  for  "Quick-Look"  updates  of  their 
potential  test  and  training  requirements. 
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c.  Field  visits  to  contact  all  potential  range 
users  as  well  as  appropriate  members  of  the  intelligence 
and  development  community. 

On  the  premise  that  TT&E  of  a weapon  system  is  done 
in  the  context  of  the  missions  for  which  the  weapon 
system  was  designed,  representative  mission  scenarios 
have  been  developed  from  the  information  obtained  in  the 
above  steps  (a-c)  for  current  requirements.  (See  2FTP  - 
H0386002.)  These  scenarios  describe  how  the  potential 
range  users  conduct  their  missions,  the  objectives  of 
their  test  and  training  programs,  their  analysis  plans, 
and  their  criteria  for  assessment  of  performance. 

The  scenarios  were  analyzed  to  identify  measurements  of 
performance  and  the  variables  which  affect  performance. 
These  data  should  allow  the  users  to  assess  performance 
by  the  operational  crews  using  the  weapon  system  over 
all  facets  of  the  missions  under  various  conditions  of 
interest.  Estimates  were  also  made  of  the  precision 
with  which  the  measurements  should  be  made  based  on  the 
identification  of  the  information  that  the  user  desires 
as  derived  from  the  mission  analysis.  A range  concept 
was  developed  to  demonstrate  what  range  functions  had  to 
be  performed  to  meet  test  or  training  objectives. 

The  range  functions  identified  for  all  the  repre- 
sentative scenarios  have  been  brought  together  to  show 
the  total  of  the  TT&E  segments,  range  safety,  and  air/ 
land  space  requirements.  These  identified  requirements 
were  compared  to  the  current  capabilities  of  the  ranges 
available  to  each  command.  Summaries  of  the  require- 
ments needed  to  provide  the  improved  TT&E  capability 
were  developed. by  range  for  each  Command.  The  require- 
ments desired  for  each  range  form  a firm  basis  for  the 
development  cind  acquisition  necessary  to  support  Air 
Force  TT&E  improvements  and  are  documented  in  related 
document  2FTP  - H0386002. 

4.2.1  Requirements  Processing 

The  Secret  document  2FTP  - H0386002,  "Requirements 
Analysis  for  Improvement  of  USAF  OTT&E,"  represents  an 
in-depth  survey  of  the  requirements  for  USAF  ZI  test  and 
training  ranges.  This  document  (2FTP  - H0386003)  and 
one  other  document,  2FTP-H03 86004 , "Intelligence  Considera' 
tions  for  Improvement  of  USAF  OTT&E,"  Secret,  provide 


35 


supporting  technical  and  intelligence  information  for 
the  capability  requirements  stated  in  2FTP  - H0386002. 

It  is  recommended  that  headquarters  USAF  validate  the 
capabilities  contained  in  these  documents  as  a class  of 
requirements  necessary  to  improve  USAF  testing  and 
traini.ng.  After  validation,  it  is  proposed  that  quantities 
from  this  family  be  authorized  and  provided  anually  to 
overcome  the  existing  OTT&E  deficiencies  and  improve 
operational  capabilities. 

This  could  be  accomplished  incrementally  as  the 
budget  will  allow.  The  validation  of  these  documents 
will  simplify  and  expedite  the  normal  justification  pro- 
cess associated  with  the  Required  Operational  Capability 
(ROC)  preparation  in  accordance  with  AFR  57-1. 

4.3  TT&E  SYSTEM  SEGMENTS 


In  earlier  sections  the  TT&E  system  was  subdivided 
into  six  segments  or  subsystems  which  were  briefly 
described  in  section  3.3.  The  succeeding  six  subsections 
deal  in  detail  with  the  equipment  and  related  matters 
for  each  segment  as  follows; 

Segment  Subsection 


Threats  4 . 4 
Targets  4.5 
Instrumentation  4.6 
Command  and  Control  4.7 
Communications  4.8 
Range  Support  4,9 


^ ^ SIMULATED  ENEMY  THREATS 

A large  number  of  test  and  training  threat  radar 
simulations  exist  within  Air  Force  and  Navy  resources. 
(See  Figure  4-1.)  The  Air  Force  simulators  available 
in  AFSC  are  used  for  DT&E,  support  of  lOT&E,  OT&E,  and 
large  scale  training  exercise.  Current  SAC  and  TAC 
capability  is  largely  for  aircrew  training,  however, 
OT&E  capability  is  planned.  The  Navy  systems  support 
essentially  the  same  kind  of  programs  but  also  support 
testing  of  anti-radiation  missile  developments. 


36 


A broad  scale  survey  of  Electronic  Warfare  Threat 
Simulations  has  been  made  by  TESPO  and  is  published  as 
a companion  Secret  document,  "Survey  and  Information  for 
Selection  of  Threat  Simulators  for  USAF  Operational 
Training,  Testing  and  Evaluation  (OTT&E)",  2FTP  - H0386007. 

This  volvime  includes  all  information  available  from 
the  Threat  Simulator  Survey  on  both  hardware  and  computer 
simulation  systems  and  facilities,  their  use,  location, 
how  they  work  together,  plans  for  improving  existing 
simulators  and  procurement  of  new  ones:  intelligence 

inputs  on  Soviet  systems  including  risk  assessment  in 
developing  new  simulators  and  a prioritized  list  of 
threat  simulations  recommended  for  development. 

The  volume  covers  the  follovjing  aspects  of  threat 
simulator  use: 

Testing 

Training 

Exercise 

Planning 

Development 

Funding 

Threat  simulations  can  be  grouped  as  follows: 

a.  Emitters. 

b.  * "Full-up"  radars  with  operators. 

c.  "Full-up"  radars  with  operators  and  including 
a scoring  capability. 

Emitters  are  the  simplest  form  of  Radar  Simulation. 
They  are  designed  to  radiate  an  RF  signal  that  duplicates 
a particular  threat  radar  signal  (e.g.,  SA-2,  SA-3) . 

The  emission  of  the  appropriate  signal  is  accomplished 
through 

radars  refer  to  threat  simulations  in  which 
the  "threat"  is  a full  functional  replication  of  an 
actual  enemy  threat  including  radar,  operators  and 
procedures. 
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various  modulation,  frequency  shift  and  antenna  tech- 
niques. Emitters  are  used  primarily  to  activate  Radar 
Homing  and  Warning  (RHAW)  devices  on  various  types  of 
aircraft  and  alert  the  aircrew  that  their  aircraft  is 
being  illuminated  by  a threat.  Emitters  can  be  built 
to  generate  either  omni-directional  or  directional  signals 
or,  if  desired,  the  antenna  may  be  slaved  to  an  IFF 
Tracker  so  that  the  antenna  is  always  tracking  a 
particular  aircraft.  When  used  in  this  manner,  emitters 
are  often  coupled  with  a remote  antenna  for  anti-radia- 
tion missile  (ARM)  testing.  An  example  of  this  type  of 
threat  simulation  is  located  at  the  Nellis  AF  Base 
Caliente  Range  and  is  being  used  extensively  for  Wild 
Weasel  Training.  In  the  case  of  ARM  Testing,  the  emit- 
ters are  located  at  the  Naval  Weapons  Center,  China 
Lake,  California,  for  launch  testing  of  the  passive/ 
homing  guided  weapon. 

The  full-up  radars  are  complete  replications  of  a 
particular  enemy  threat  radar  system.  They  include  all 
of  the  siabsystems  of  the  threat  system  (i.e.,  trans- 
mitters, receivers,  antennas,  display  scopes,  etc.)  and 
require  operators  to  perform  all  of  the  functions  as 
performed  in  the  actual  threat  systems.  In  most  in- 
stances, the  system  is  designed  to  have  the  exterior 
physical  as  well  as  electronic  appearance  of  the  actual 
threat  system.  This  type  of  system  is  much  more  sophis- 
ticated and  costly  than  the  emitter  only  system.  They 
are  used  in  training  programs  and  OT&E  in  which  the 
effects  of  ECM  must  be  evaluated.  Examples  of  these 
systems  are  the  QRC-207  SA-2  Simulator  and  West  II 
Early  Warning  Radar  Simulator  at  Eglin  AF  Base?  the 
MPQ-T7  and  MPQ-T8  Simulators  at  Nellis  AF  Base. 

The  third  group  are  also  full-up  radars  but  include 
a capability  to  score  the  effects  of  ECM.  In  this  design, 
a computer  and  a computer  model  of  a specific  SAM  missile 
are  added.  Scoring  the  effect  of  ECM  on  the  radar  is 
stated  in  terms  of  miss-distance  which  can  be  detennined 
in  various  ways,  one  of  which  is  briefly  described.  In 
the  case  of  the  Air  Force  MPS-Tl  which  can  simulate  any 
of  three  different  SAM  radars,  one  of  the  pedestals  which 
is  not  programmed  to  be  jammed  will  provide  a reference 
track  of  a beacon  on  the  target  aircraft  while  operators 
controlling  one  of  the  other  two  pedestals  affected  by 


ECM  is  attempting  to  track  the  apparent  position  of  the 
target  aircraft.  Both  the  reference  track  position  and 
the  apparent  position  from  the  radar  being  jammed  are 
passed  on  to  the  computer.  When  the  missile  launch 
button  is  depressed,  the  computer  works  out  the  missile 
flight  profile  to  the  target  position  as  determined  from 
the  system  being  jammed.  At  the  end  of  missile  flight 
time  to  the  target  position,  the  computer  determines  the 
difference  between  the  reference  target  position  and  the 
actual  target  position  indicated  by  the  radar  being 
jammed  and  a print-out  showing  missile  miss-distance  in 
feet  is  made.  These  systems  are  employed  by  both  TAG 
and  SAC  and  have  been  used  for  both  training  and  OT&E. 

To  be  useful  for  OT&E  and  training,  the  threat  simu- 
lators must  adequately  duplicate  the  aspects  of  the 
enemy  system  being  simulated,  whether  it  be  emissions 
only  or  a full-up  radar.  The  process  (see  Figure  4-2) 
of  assuring  the  adequacy  of  the  simulation  is  referred 
to  as  validation.  For  the  Air  Force  the  validation 
process  is  the.  responsibility  of  the  Foreign  Technology 
Division  of  the  Air  Force  Systems  Command.  The  valida- 
tion process  may  be  summarized  as: 

a.  The  compilation  of  the  intelligence  data 
input  package  (IDIP)  from  FTD  for  use  by  the  developer 
in  specifying  characteristics  of  the  model  or  simulator 
design,  or  alternatively  as  valid  input  parameters  from 
established  simulators. 

b.  Specification  of  validation  tests,  monitoring 
these  tests  and  evaluation  of  test  results  for  comparison 
of  simulator  performamce  with  real  and/or  estimated 
threat  performance. 

c.  Certification  that  the  simulator  has  been  com- 
pared with  current  knowledge  of  the  enemy  system  and 
does  represent  the  foreign  system.  Deficiencies,  if 
any,  will  be  identified. 

4 . 5 TARGETS 

Proper  conduct  of  OTT&E  missions  requires  both  air- 
borne and  ground  targets  (See  Figure  4-3) . Ground  tar- 
■gets  are  further  categorized  as  stationary  or  mobile. 
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Whether  the  targets  are  groxind  or  airborne,  they  must 
possess  realistic  characteristics  to  provide  meaningful 
test  and/or  training.  A survey  of  ground  targets  has 
recently  been  conducted  by  AFSWC/TESPO  and  is  published 
as  a related  document  "Survey  and  Information  for  Selection 
of  Ground  Targets  for  USAF  OTT&E" , 2FTP  - H0386006. 

DDR&E  is  conducting  a detailed  survey  of  airborne 
targets  requirements  and  capabilities  through  a contract 
to  the  Mitre  Corporation. 

4.5.1  Ground  Targets 

As  mentioned  above,  ground  targets  consists  of  two 
categories;  stationary  and  mobile.  In  the  stationary 
category,  there  are  fixed  electronic  warfare  emitters 
and  fixed  site  targets  such  as  rail,  bridges,  ammunition 
dvimp  replicas,  and  airfields. 

4. 5. 1.1  Fixed  EW  Emitters 

These  consist  of  hardened  modulated  emitters  which 
simulate  real  threat  emission  and  which  are  associated 
with  above  ground,  expendable  mock-ups  of  air  defense 
radar  sites  against  which  live  ordnance  may  be  expended 
for  ARM  training.  Provisions  should  be  made  for  remote 
control  of  RF  emissions  to  permit  simulation  of  Red 
Force  emission  control  tactics  used  during  defense 
suppression  type  operations.  It  is  very  important  that 
the  RF  emissions  be  valid  for  the  actual  target  being 
simulated. 


4. 5. 1.2  Fixed  Sites 

The  other  fixed  targets  consist  of  simulated  enemy 
resources  (passive)  such  as  fuel  and  ammunition  dumps, 
bridges,  railways,  airstrips,  troop  concentrations  or 
camp  areas,  and  other  terrain  features  similar  to  the 
areas  beyond  the  FEBA.  These  targets  generally  require 
routine  civil  engineer  or  contract  services  for  initial 
buildup  and  repair  or  replacement  as  required.  More 
realism  sometimes  can  be  obtained  by  the  use  of  camou- 
flage. 


4.5.2  Airborne  Targets 

Several  versions  of  airborne  targets  are  available. 
Some  are  towed  (Towbee,  Dart,  FIGAT)  and  some  are  self- 
powered  (BQM-34A/F,  PQM-102,  HAST).  The  DDR&E  study  now 
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underway  through  the  Mitre  Corporation  will  better 
define  the  airborne  target  requirements  and  availa- 
bility Figure  4-4  shows  some  of  the  types  of  enemy  , 
aircraft  that  might  possibly  be  encountered.  The 
physical  and  performance  characteristics  of  each  to  be 
simulated  should  be  well  defined  so  realistic  airborne 
targets  can  be  produced  for  valid  testing  and  training. 

4 . 6 INSTRUMENTATION 


The  subsections  which  follow  discuss  data  acquisi- 
tion systems  which,  in  some  cases,  include  rather 
extensive  display  and  computing  facilities  as  part  of 
the  subsystem  identified.  The  discussion  of  specific 
systems  is  preceded  by  a general  discussion  of  evalua- 
tion equipment  and  methodology. 

4.6.1  Electronic  Warfare  Evaluation  Equipment 
and  Methodology  (Figures  4-5  and  4-6) 

As  a penetration  aid  to  an  aircraft  strike  force, 
the  objective  of  electronic  warfare  is  to  enhance  the 
probability  of  a strike  force  penetrating  an  air  defense 
system  to  the  point  of  ordnance  delivery  and  exiting 
safely.  The  effectiveness  of  electronic  warfare  can  be 
related  directly  to  its  eibility  to  prevent,  delay  or 
degrade  the  occurrence  of  critical  functions  of  the  air 
defense  system.  Since  a major  portion  of  a training 
range  activity  can  involve  EW  effectiveness  evaluation, 
the  instrumentation  must  be  comprehensive  enough  to 
allow  evaluation  of  all  aspects  of  EW;  e.g.,  communica- 
tions jamming,  attrition  of  defense  elements  (as  en- 
hanced by  EW) , electro-optical  and  IR  counteinneasures, 
attrition  of  strike  aircraft,  air  defense  use  of  ECM/ 
strike  force  use  of  ECCM,  utilization  of  Elint  and 
STGKT,  etc. 


4. 6. 1.1  Measures  of  Effectiveness 

Measures  of  effectiveness  for  EW  can  be  associated 
with  the  various  events  which  occur  when  a strike  force 
is  engaged  by  an  air  defense.  The  ultimate  measure 
of  effectiveness  is  the  kill  probability  of  strike 
aircraft  by  the  air  defense,  or  the  aircraft  attri- 
tion in  m.eeting  the  strike  objectives.  Evaluating 
this  involves  measuring  the  miss-distance  of  the  simulated 
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air  defense  SAM  or  AAA  fire  and  relative  missile  and 
aircraft  attitudes.  Most  of  the  other  events  associated 
with  the  engagement  are  useful  primarily  in  explaining 
the  *'why"  for  the  aircraft  attrition.  Nevertheless, 
scoring  on  the  basis  of  key  events  may  be  the  primary 
source  of  EW  effectiveness  evaluation  until  miss-distance 
scoring  can  be  implemented  for  the  fire  control  radars. 

In  the  following,  the  principal  events  and  the  associated 
measures  of  effectiveness  are  identified,  in  the  order 
in  which  they  would  occur  in  a typical  strike  mission. 
Note  that  the.  most  important  measure  of  effectiveness  is 
at  the  end,  aircraft  attrition.  In  general,  the  meas- 
ures of  effectiveness  would  be  relative  to  either 
operation  without  EW  or  to  some  baseline  EW  system. 

While  not  specifically  identified,  events  associated 
with  air  defense  use  of  ECM  against  the  Blue  strike 
force  must  also  be  noted;  e.g.,  jamming  of  terrain 
avoidance  radar  or  command  and  control  communications. 

a.  Detection  and  Identification  of  Threat 
Radar  Signals  by  Aircraft  Electronic  Support  Measures 
(£^m)  Equipment  (Early  Warning,  Acquisition  or  F'ire 
Contrb i ) 


- Range  at  which  early  warning/acquisition  radars 
are  identified. 

- Range  at  which  threatening  fire  control  radars 
are  identified, 

- Delay  time  between  activation  of  successive 
modes  on  a fire  control  radar;  e.g.,  missile  launch/ 
track,  and  ESM  identification. 

b.  Evasive  Action  by  Aircraft;  e.g. , to  avoid 
detection  or  to' 'cause  miss  by  SAM/AAA. 

- Delayed  detection  range. 

- SAM/AAA  miss  distance. 

c , Initiation  of  ECM  Activity  by  Aircraft; 
e.g.,  against  early  waming/acquisition  radar,  fire 
control  radar  or  communications. 

- Delay  in  transmission  of  track  and/or  target 
assignment  infojraation. 
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- Delay  in  detection/track  by  SAM/AAA  acquisition 

radar. 

- Delay  in  detection/track  by  SAM/AAA  fire  control 

radar . 

- SAM/AAA  miss  distance. 

d.  Aircraft  Detection/Track  by  Air  Defense 
Early  Warning /Acquisition  Radars 

- Number  of  strike  and  support  aircraft  (and 
other  aircraft  and  fake  targets)  tracked  by  early 
warning  and/or  acquisition  radars. 

- Delay  in  transmission  of  track  information  to 

ADWOC. 

- Delay  in  acquisition  of  assigned  target  air- 
craft by  SAM/AAA  acquisition  radar. 

e.  Air  Defense  Identification  of  Track  as 

Hostile 

- Fraction  of  strike  and  support  aircraft  (and 
other  aircraft  and  false  targets)  assigned  hostile 
track  ID. 

- Delay  in  hostile  track  identification. 

f . Assignment  of  Targets  to  Red  Interceptors 

- Delay  in  assigning  target  aircraft. 

- Accuracy  of  GCI. 

g.  Assignment  of  Aircraft  Target  to  Air  Defense 
Regiment 

- Fraction  of  aircraft  designated  as  targets  to 
SAM/AAA  regiments. 

- Delay  in  assigning  target  aircraft  to  regi- 
ment. 
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h .  Assignment  of  Target  Aircraft  to  SAM/AM, 
Battalion 


~ Fraction  of  aircraft  targets  designated  to 
SAM/AAA  battalions. 

” Delay  in  assigning  target  aircraft  to  SAM/AAA 
battalion. 

i.  Aircraft  vithin  Weapon  Range  of  an  Operational 
SAM/AAA  Weapon  System  (which'  has  been  designated  to 
engage  the  aircraft) . 

“ Fraction  of  aircraft  exposed  to  SAM/AAAs. 

j . Air  Strike  Against  SAM/AAA  Elements 

- Attrition  of  SAJM/AAA  elements. 

- Residual  SAM/AAA  effectiveness. 

k.  Launch  of  Anti-Radiation  Missile  (ARM)  by 
Aircraft  Against  Air  Defense  Fire  Control  Radar 

- Decrease  in  aircraft  exposure  time  to  "active" 
fire  control  radar. 

- Number  of  SAM/AAA  fire  control  radars  killed 
(depends  both  on  ARM  performance  and  defense  reaction 

to  ARM) . (The  effectiveness  measure  should  be  continued 
to  include  weighting  on  the  basis  of  the  relative 
importance  of  each  radar.) 

l.  Track  Establishment  by  SAM  or  AAA  Fire 
Control  Sys^m  (Radar  or  Optical)  Sufficient  to  Initiate 
Fire 


- Delay  in  acquisition/track  of  assigned  target 
aircraft. 

“■  Percentage  of  time  an  exposed  aircraft  is 
tracked. 


- Percentage  of  aircraft  tracked  by  SAM/AAA 
fire  control  systems. 

- Accuracy  of  acquisition  data  passed  to  SAM/AAA 

radars . 
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SAM  Missile  Launch  or  AAA  Fire  Against 
Target  Aircraft 

- Percentage  of  aircraft  engaged. 

- Number  of  SAMs  launched  or  AAA  expended. 

- Delay  in  SAM  launch  or  AAA  fire. 

n.  Aircraft  Kill  by  SAM/AAAs 

- SAM/AAA  miss  distance. 

- Percentage  of  aircraft  destroyed. 

Implementation/determination  of  the  above  measures 
of  effectiveness  (MOEs)  is  straightforward  except  for 
those  associated  with  ARM  launch  and  the  SAM/AAA  miss 
distance.  Those  are  complicated  by  the  fact  that  the 
ARM/SAM/AAA  firings  and  flight  profiles  are  simulated; 
i.e.,  not  actual  firings  during  the  aircraft/air 
defense  engagement.  Aircraft  evasive  action  to  SAMs 
has,  in  the  past,  depended  strongly  on  visual  observa- 
tion of  the  SAM,  while  the  SAM  system  reaction  to  an 
ARM  may  depend  on  radar  or  visual  detection  of  the  ARM. 
It  may  be  possible  to  provide  simulated  indications  of 
the  ARI^  launch  to  the  affected  SAM/AAA  element. 

o.  Other  Measures.  Other  items,  some  of 
which  are  directly  related  to  the  measures  of  effective' 
ness,  that  should  be  determined  or  recorded  include: 

- Video  recordings  of  air  defense  displays 
showing  the  effects  of  ECM  and  defense  ECCM.  These 
recordings  would  be  useful  for  post-mission  review 
and  pilot  debriefings. 

- Jamming-Signal  ratio  measurement  at  threat 
radars  and/or  communications  receivers.  This  data 
will  be  useful  in  determining  why  certain  values  for 
measures  of  effectiveness  were  obtained. 
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” Comparison  of  early  warning/acquisition  radar 
traicks  with  TSPI  data.  Useful  in  determining  the 
accuracy  of  radar  tracking,  and  in  quantifying  false 
track  or  no  track  conditions. 

- Induced  error  rates  on  Integrated  Air  Defense 
System  (IADS)  communications  links.  This  is  a measure 
of  the  effectiveness  of  communications  jamming.  The 
effects  of  the  jamming  would  also  affect  the  appropriate 
measures  of  effectiveness  noted  previously. 

- Recording  of  operator  commentary. 

- Recording  of  selected  communications  links 
(both  Blue  and  Red) . 

->  Recording  of  the  jamming  environment  in  the 
terminal  areas. 

The  effectiveness  of  electronic  warfare  as  a 
penetration  aid  to  an  aircraft  strike  force  is  directly 
related  to  the  degradation  of  critical  functions  within 
an  Integrated  Air  Defense  System. 

Degradation  within  the  Integrated  Air  Defense 
System  occurs  v;ithin  the  following  key  elements; 

- Surveillance  network. 

- Command  and  Control. 

- Communications, 

- Tenranal  threat  acquisition/tracking. 

- Term3.nal  threat  weapons. 

4. 6. 1.2  Surveillance  Radars 

A test  and  training  range  may  have  a requirement  to 
determine  the  contribution  of  electronic  warfare  in 
degrading  the  effectiveness  of  early  warning,  acquisition, 
height  finder  and  surveillance  radars  in  accomplish- 
ing their  function  in  the  Red  system  structure.  These 
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radars  initiate  track  information  which  is  used  through- 
out any  defense  system  and  a measure  of  EW  effectiveness 
against  this  segment  is  essential  in  any  overall 
exercise  evaluation. 

a.  Data  Requirements.  The  EW  effectiveness 
evaluations  must  be  implemented  such  that  results  derived 
from  the  evaluations  do  not  lead  to  erroneous  conclu- 
sions on  the  part  of  test  analyst  and  users  as  to  the 
effectiveness  of  jammers  and  EW  tactics  on  the  defense 
system  scenario.  The  following  data  should  be  available 
upon  which  to  base  EW  effectiveness  for  the  surveillance 
radars: 

- TSPI. 

- Radar  status  data. 

- Operator  track  information. 

- IFF  performance. 

Collateral  support  data  includes: 

- Terrain  masking. 

- Radar  coverage. 

- Radar  antenna  data. 

- Target  cross  section. 

- Video  tape  recordings. 

- J/S  data. 

Through  use  of  these  data  resources,  at  least  a partial 
evaluation  of  the  effect  of  electronic  warfare  on  total 
system  performance  may  be  determined.  The  only  true 
measure  of  EV?  effectiveness  is  to  compare  losses  from 
GCI  and  terminal  threat  systems  which  are  incurred  when 
identical  scenarios  are  run  with  and  without  ECM. 

b.  Candidate  System  Description.  The  EW 
effectiveness  evaluation  system'  for  the  radar  systems 
will  be  based  upon  a computation  capability  at  each 
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radar  and  the  EW  effectiveness  evaluation  system  must 
be  capable  of  the  following  operations? 

“ Correlate  available  point  targets  with  targets 
acquired  and  tracked  by  the  radar  and  operator. 

- Measure  the  jamming  to  signal  (J/S)  ratio  about 
each  target. 

- Maintain  a time  and  event  history  sxrmtiary  for 
each  target  within  the  range  of  the  radar  and  terminal 
system. 


- Pass  the  resulting  evaluation  data  to  the  next 
higher  echelon  of  the  EW  effectiveness  evaluation 
system  for  correlation  and  use  by  that  system  as  inputs 
for  subsequent  evaluations.  Figure  4-7  depicts  the 
typical  signal  flow  diagram  of  the  EW  effectiveness 
evaluation  system  and  the  data  required,  computing 
support  system  capability,  and  result  files  available. 

To  assist  in  EW  effectiveness  evaluations  and 
training,  a video  tape  recording  system  can  be  inte- 
grated into  each  radar  system.  The  video  recording 
system  v/ould  have  a playback  mode  to  enable  training, 
briefing,  and  debriefing  of  system  operators,  analysts, 
and  range  users, 

c.  Alternate  Approaches.  An  alternate  approach 
to  achieving  a measure  of  EW  effectiveness  would  be  to 
•perform  post-mission  analysis.  The  major  problem  in 
this  approach  is  that  real-time  correlation  with  other 
range  events  cannot  be  accomplished.  Specifically, 
evaluations  of  system  performance  may  be  jeopardized 
by  inabilities  to  remove  participants  from  the  scenario 
and  interject  this  data  into  the  acquisition  process. 
The  ability  to  remove  targets  in  an  improved  system 
operation  is  readily  implemented.  The  post-mission 
analysis  approach  could  be  utilized  initially  where 
there  is  no  real  time  processing  capability  at  each 
radar. 
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d.  Considerations.  A primary  technical  con- 
sideration is  in  proper  sizing  of  the  remote  computer 
system  at  each  radar  to  handle  the  EW  effectiveness 
evaluation,  GCI  capability,  and  the  IADS  semiauto- 
matic capability.  If  necessary,  remote  collocated 
vans  to  handle  these  functions  must  be  provided  and 
interfaced  at  the  common  data  point.  The  remote  vans 
concept  is  in  harmony  with  actual  policies  under  which 
system  improvements  are  added  as  separate  units  with 
minimvim  modification  to  existing  hardware. 

e.  Recommendations . It  will  be  necessary 

to  evolve  the  EW  scoring  system  which  initially  will 
be  based  upon  recording  of  event  data  and  post-mission 
analysis.  However,  with  the  incorporation  of  a semi- 
automatic IADS  system,  real-time  remote  computation, 
data  aoqvxisition  and  EW  effectiveness  evaluations 
will  be  possible.  The  modifications  to  existing  hardware 
could  be  initiated  by  incorporation  of  an  electronic 
warfare,  common  data  point  to  the  existing  instrumenta- 
tion common  data  point.  This  system  would  be  a paral- 
lel signal  processing  receiver  using  only  the  radar 
local  oscillator  and  adding  separate  IF  sections 
(without  ECCK  measures) . The  signal  output  from  this 
parallel  receiver  section  may  be  used  to  measure  the 
following  items? 

- Jammer  power  level  and  spectrum. 

- Signal-to-noise  ratio. 

In  addition,  measurement  and  signal  processing  equip- 
ment will  be  used  to: 

- Determine  jammer  status  (off-on) . 

- Determine  the  jammer  identification  in  con- 
junction with  the  frequency  spectrum  surveillance 
system. 

4 . 6 . 1 , 3 Command  and  Control  System 

Air  defense  command  and  control  functions  might  be 
disrupted  or  degraded  either  through  noise  jamming  or  by 
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introduction  of  erroneous  data  into  the  coicitiand  and 
control  structure  (deception  jarnming)  . Similar  degrade- 
tion  of  Blue  command  and  control  might  occur  due  to  Red 
Force  use  of  ECM.  ECM  action  is  intended  to  CAUse  one 
or  more  of  the  following  operational  problems: 

- Delays  in  passing  air  situation  track  data. 

- Delays  in  making  and  passing  operational 
decisions  and  directives. 

- Accuracy  in  receptions  and  data  transfer. 

a.  Candidate  System  Description.  The  EW 
effectiveness  evaluation  system  for  the  command  and 
control  structure  can  be  based  only  upon  measuring  the 
accuracy  and  correlation  of  transferred  data  and  not 
upon  the  decisions  which  are  made.  The  evaluation 
would  be  based  upon  noting  the  following  at  each 
decision  element  within  the  air  defense  system. 

- Correlation  of  multiple  inputs  to  effectiveness 
in  passing  singular  outputs. 

- Through-put  delays. 

- Accuracy  of  position  and  velocity  of  outputs. 

- False/valid  tracks  passed  into  the  system. 

- False/valid  tracks  generated  by  the  system. 

- False/valid  tracks  picked  up  by  the  system. 

- False/valid  tracks  output  from  the  system. 

- False/valid  tracks  dropped  by  the  system. 

Associated  with  the  above  data,  accuracy  in  reception 
and  transfer  of  track  and  target  data  and  associated 
delays  in  passing  track  information  and  in  making  and 
passing  operational  directions  must  also  be  assessed. 
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b.  CoitBTiuncations  Scoring.  Experience  indicates 
that  defense  command  and  control  functions  can  be 
disrupted  by  degrading  or  eliminating  communications 
through  ECM  action.  Blue  communications  should  also 

be  subjected  to  realistic  ECM  action  to  allow  evaluation 
of  susceptibility. 

c.  Candidate  System  Description.  The  defense 
communications  system  is  a set  ot  radio  and  microwave 
linlcs  interconnecting  the  surveillance,  command, 
control  and  terminal  threat  systems  over  which  digital 
and  voice  data  is  transferred.  Degradation  of  the 
command,  control  system  as  a function  of  communications 
jaxtaning  can  be  evaluated  in  terms  of  reduced  informa- 
tion capacity,  delays  in  message  transmission,  recep- 
tion of  erroneous  or  confusing  messages  and  errors  in 
digital  data  transmission.  Blue  command  and  control 
performance  in  an  ECM  environment  can  be  evaluated  in 
analogous  fashion.  The  proposed  system  is  outlined 
below; 


- Digital  Links.  Measurement  of  bit  error  rates. 

- Voice/Video  Links.  Operator  notation  as  to 
thej  quality  of  reception. 

*"  Alternates.  An  alternate  system  could  be 
implemented  to  provide  an  interference-free  channel  to 
petmit  numerical  evaluation  of  the  jammed  channel  per- 
formance as  compared  to  the  interference  free  channel 
output. 


d.  Recommendations . It  will  be  necessary 
to  evolve  the  communications  scoring  system  based  upon 
basic  requirements  and  the  task  for  both  manual  systems 
and  the  expansion  of  the  associated  semiautomatic 
detense  system.  Radio  signal  reporting  codes  denoting 
signal  strength,  interference,  noise,  modulation  dis- 
turbance, frequency  of  fading,  modulation  quality  and 
depth  and  frequency  of  message  repeats  will  be  tabu- 
lated as  needed  for  each  transmission  of  voice,  data, 
and  teletype  messages.  Software  modifications  could 
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provide  a real-time  log  of  digital  error  rates,  and  key 
set  inputs  to  the  data  acquisition  system  for  report- 
ing the  quality  of  voice  and  video  reception. 

“ Key  Sets.  Key  sets  for  manual  input  of  signal 
reception  quality  must  be  provided  to  each  operator. 

- Computer  System.  Capability  to  determine  and 
tabulate  bit  error  rates  must  be  incorporated  into  each 
modem  I/O  channel. 

4. 6. 1.4  Terminal  Threat  Acquisition 

There  exists  a niomber  of  measures  of  effectiveness 
appropriate  to  an  evaluation  of  the  effect  of  EW  on  a SAM 
or  AAA  battery  and  various  supporting  measurements  and/or 
recordings  that  should  be  made.  Events  appropriate  to 
SAM  or  AAA  battery,  for  which  the  occurrence  and  times 
should  be  noted,  include: 

a.  Assignment  of  target  aircraft. 

b.  Position  and  velocity  errors  in  assign- 
ment . 

c.  Assigned  target  aircraft  within  weapon 

range . 

d.  Fire  control  radar  on. 

e.  Track  established. 

f.  Track  estciblished  valid  with  assignment. 

g.  SAM  launch  or  AAA  fire. 

h.  Track  lost. 

i.  Target  disengaged. 

j.  Onset  of  jamming. 

k.  ECCM  action. 
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ARM  detect ion/warning  received, 
m.  Fire  control  radar  off. 

All  of  these  can  be  treated  as  functions  which  are 
routinely  transmitted  by  an  on-site  scoring  system 
for  real-time  use  and/or  recording.  Other  functions 
such  as  " switchology"  functions  which  are  recorded 
and  transferred,  include:  radar  pulse  repetition 

frequency  (PRF) ; gain  setting,  azimuth,  elevation 
and  range  to  target  aircraft;  radar  mode  (e.g..  Track 
While  Scan  (TWS) , Lobe  On  Receiver  Only  (LORO) ; dish 
mode)  and  range  settings.  Operator  comments  should  also 
be  recorded  to  provide  a valuable  augmentation  where 
events  or  reactions  to  events  are  uncertain. 

a.  Defense  System  Description.  The  terminal 
threat  defense  system  is  a set  of  SAM  and  AAA  elements 
and  various  supporting  systems.  Degradation  in  the 
effectiveness  of  these  systems  to  perform  their  tasks 
is  initially  evident  from  degradation  in  the  following 
items ; 


- Accuracy  of  position  and  velocity  of  assigned 
targets . 

- Ability  to  acquire  and  track  assigned  targets 
whether  assigned  or  as  targets  of  opportunity. 

- Validity  in  tracking  correct  targets. 

- Ability  to  correlate  a separate  false  track 
and  valid  track  when  targets  are  acquired. 

Associated  with  the  above  data,  accuracy  in 
reception  and  transfer  of  track  data  to  subordinate 
terminal  threat  systems,  and  associated  delays  in 
passing  track  information  and  in  making  and  passing 
operational  direction  must  be  denoted. 

b.  Candidate  Systems 

Computer  Assist.  Use  of  a computer  to 
■separate  the  3ata  when  Range  TSPI  and  radar  parameters 
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are  known  in  conjunction  with  track  data  passed  to  the 
element.  The  principal  problem  with  using  the  computer 
system  is  that  digital  data  representing  tracks  passed 
to  the  system  are  necessary  along  with  an  external  range 
TSPI  system. 

2)  Video  Recordings.  Video  recordings  of 
radar  video  for  post-mission  scoring  of  the  acquisition 
and  tracking  portion  of  the  terminal  phase  could  be 
used. 


3)  Recommendations . The  video  recording  system 
will  permit  post-mission  analysis  of  the  ability  of  the 
operator  to  acquire  and  track  a target.  With  external 
TSPI  for  terminal  threat  scoring,  the  resolution  to  which 
a track  is  established  and  maintained  will  be  known,  and 
real-time  scoring  will  be  possible.  Post-mission  analyst 
to  determine  the  validity,  and  ability  to  separate  false 
tracks,  accuracy  of  position  and  velocity  of  assigned 
target,  and  associated  system  delays  will  be  required. 

4. 6. 1.5  Terminal  Threat  Scoring 

The  ultimate  measure  of  effectiveness  of  EW  against 
an  air  defense  is  the  success  (or  degree  of  success)  of 
the  mission;  i.e.,  was  the  aircraft  (or  strike  force) 
able  to  successfully  penetrate  to  its  weapons  release 
point?  Evaluating  this  measure  of  effectiveness  involves 
a determination  of  the  probability  of  kill  or  SAM  and/or 
AAA  firings  against  the  aircraft  (or  strike  force) . 

Two  basic  options  are  available: 

a.  Record  events,  flight  profiles,  etc.,  and 
through  post-mission  analysis,  derive  estimates  of 
defense  element  attrition  and  aircraft  attrition. 

The  post-mission  analysis  would  then  be  done  via  use 
of  simulations;  e.g.,  the  Air  Force  Electronic  War- 
fare Evaluation  Simulator  (AFEWES)  and  Tactical  Air 
Defense  Battle  Model  (TADBM,  a modified  version  of  the 
Air  Force  Tactical  Digital  Model) . The  primary 
difficulties  are  the  long  post-mission  analysis  time 
before  results  are  known  and  the  lack  of  realism 
engendered  in  doing  kill  removal  after  the  fact;  e.g.. 
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an  aircraft  "killed"  early  in  the  engagement  still 
completes  the  mission,  including  use  of  ECM  against 
subsequent  air  defense  elements. 

b.  Incorporate  real-time  (or  near  real-time) 
miss  distance  determination  (and  sxibsequent  kill 
probability  calculation)  into  the  instrumentation  for 
simulated  ground-to-air  scoring  at  the  site.  Two  alterna- 
tives can  be  considered  for  implementing  miss  distance 
scoring:  use  of  a tracking  system  external  to  the 

threat  fire  control  radar  (e.g.,  TSPI)  or  use  of  a 
tracking  system  essentially  integral  to  the  threat  radar 
(i.e.,  mounted  on  the  same  pedestal).  Both  techniques 
would  require  computer  simulation  of  the  SAM  or  AAA 
trajectory,  etc. , in  response  to  guidance  and/or  com- 
mands from  the  corresponding  fire  control  radar. 

1)  System  Elements . The  terminal  threat 
scoring  systeinwould  incorporate  the  following  items 
to  enable  evaluation  of  EW  effects  upon  the  terminal 
threat  system  performance. 

- On-site  scoring  evaluations  with  only  the 
results  transmitted  to  a Range  Control  Center. 

- Missile  track  loops. 

- TSPI  for  implementing  miss  distance  scoring. 

2)  Candidate  Systems.  The  basic  alterna- 
tives for  implementing  ground-to-air  scoring  are: 

- Use  of  external  TESPI  for  target  tracking. 

- Use  of  a tracking  system  which  is  an  integral 
part  of  the  threat  radar. 

a)  Considerations . Use  of  the  TSPI  for 
scoring  ground-to-air  requires  that  the  TSPI  and  fire 
control  radar  be  "registered"  into  the  same  coordinate 
system  (i.e.,  calibrated)  for  SAM/AAA  trajectory  simu- 
lation and  control  (command  from  radar) . Achieving 
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this  is  complicated  by  the  fact  that  threat  radars 
are  frequently  moved  and  set  up  for  operation  on 
crudely  prepared  sites.  Even  if  rarely  moved,  and 
operated  from  concrete  pads,  the  problem  of  achieving 
sufficiently  accurate  registration  has  been  a problem 
in  the  past.  Great  care  should  be  taken  in  this  mat- 
ter and  reference  is  made  to  the  later  section  4. 6. 8.1, 
Calibration. 

b)  A scoring  system  approach  where  the 
target  TSPI  is  incorporated  as  an  integral  portion  of 
the  threat  radar 'could  include  the  following  approaches: 

- IFF. 

- Optical  (passive) . 

- Laser. 

- Mixture  of  optical  and  laser  systems. 

- Transponder. 

- Radar. 

Disadvantages  of  one  or  another  of  these  approaches 
include: 


- Eye  Safety  Problem. 

- Dynamic  effects  upon  the  threat  system. 

- Shadowing  of  transponders. 

- Requirement  for  cooperative  transponders 
on  aircraft. 

- Contrast  ratio  problem  of  targets  against 
a horizon  (horizon  crossings) . 

- Target  registration. 

- PRF  matching  problems. 

- Jamming  by  EW  systems. 
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c.  Candidates.  A matrix  summary  of  candi- 
dates and  criteria  considered  is  shown  on  Table  4.1. 

The  matrix  shows  the  parameters  and  trade-offs  for 
providing  TSPI  for  EV?  scoring  from  a central  range 
TSPI  system  and  a local  TSPI  system  dedicated  to  an 
individual  threat  system.  A separate  local  TSPI  is 
desirable  for  use  with  small  training  missions  consist- 
ing of  one  to  four  ship  flights,  particularly  if  the 
system  does  not  require  an  aircraft  pod.  A comparison 
of  the  various  techniques  indicates  that  for  a reinge 
TSPI  system  covering  large  EW  exercises  the  multilater- 
ation  system  appears  to  be  the  best  since  it  will  handle 
large  numbers  of  participants.  However;  it  requires 
that  pods  be  carried  by  the  aircraft  and,  depending  on 
the  operations  frequency,  could  encounter  interference 
from  jammers  during  an  EW  exercise.  Radar  TSPI  systems 
for  large  exercises  present  a major  problem  in  that  they 
are  essentially  one-on-one  trackers  so  that  a larger 
number  of  radars  would  be  required.  The  Global  Position- 
ing System  CGP3)  is  promising  as  a range  TSPI  system; 
however,  it  will  not  be  available  until  the  1978-1980 
period.  The  IFF  system  can  track  a large  number  of 
participants  but  does  not  provide  the  accuracy  required 
for  miss  distance  EW  scoring. 

In  comparing  local  TSPI  systems,  the  K-band  ON-AXIS 
radar  appears  advantageous  provided  enough  power  can 
be  obtained  to  operate  at  the  ranges  required.  Some 
degradation  of  radar  performance  will  occur  during 
severe  fog  or  rain  conditions.  The  major  advantage 
of  the  K-band  radar  is  that  it  will  not  now  interfere 
with  the  aircraft  RHAV7  equipment.  Optical  tracking 
techniques  can  be  used;  however,  optics  are  not  all 
weather.  Laser  systems  with  sufficient  power  to  score 
at  the  ranges  required  are  potentially  dangerous  to 
humans.  Local  IFF  cannot  provide  the  accuracy  required 
for  EW  scoring.  A multilateration  system  appears  to 
provide  the  most  promising  system  for  range  TSPI  for  EW 
scoring  and  ON-AXIS  radar,  preferable  in  the  K-band 
range,  shoves  the  most  promise  for  local  TSPI  scoring  for 
EW. 
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EW  TSPI  MATRIX 
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It  should  be  realized  that  all  radio  class  TSPI 
systems  have  vulnerability  to  jamming  signals,  and 
that  as  new  jamming  frequencies  are  required  in  the  EW 
arena,  problems  will  arise  with  respect  to  TSPI  systems 
and  corrective  action  v/ill  be  required. 

d.  Video  Record/Playback  and  Display.  The 
evaluation  ot'  EW’ effectiveness  for  several  simultaneous 
EW  engagements  of  Blue  forces  against  combinations  of 
threat  systems  may  be  accomplished  on  some  of  the 
ranges.  In  conjunction  with  digital  analysis  for 
determining  EW  pilot  training,  mission  review  and  EW 
briefing  reviews  and  presentations,  adeqauate  recording 
of  displays  communications,  and  related  matter  are 
required. 


1)  System  Description.  The  recording  system 
must  be  capable  of  recording  the  following  data; 

- Operator  video. 

- IFF. 

- Switchology. 

- Voice  data. 

- Time. 


>-  Digital  data. 

Such  a system  is  contemplated  at  the  radar  or  other  data 
acquisition  center.  Recording  may  be  done  on  a single 
recorder  having  the  required  number  of  channels  includ- 
ing video  or  alternatively,  may  be  done  on  several  separate 
time  synchronized  recorders. 

Alternative.  As  an  alternate  to  record- 
ing video  at  tHe"  radar  for  White  instruirient  action  pur- 
poses, video  data  could  be  microwaved  to  a Range  Control 
Center  for  recording  and  display.  However,  the  video 
remoting  for  White  instruir.entation  would  require  con- 
siderable bandwidth  in  the  communications  system.  Also, 
the  system  would  not  lend  itself  to  on-site  display  capa- 
bility for  operator  training  at  the  radar. 
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4.6.2  Aircraft  Communications  Evaluation  System 
(ACES) . (Figure  4-S) 

4. 6. 2.1  General 


a.  The  impact  of  the  hostile  Ground  Controlled 
Interceptor  (GCI)  aircraft  in  a broad  category  of  USAF 
aircraft  mission  objectives  has  been  estimated  based 
exclusively  upon  the  results  of  analytical  and  labora- 
tory hardware  simulations. 

b.  A portion  of  the  GCI  system  (except  for 
on-board  aircraft  weapons  and  guidance  equipment) 
deals  exclusively  with  ground  based  mid-course  guidance 
to  place  the  GCI  aircraft  in  the  area  where  visual 

or  airborne  radar  contract  enables  terminal  inter- 
cept to  begin. 

4.6.2. 2 GCI  System 

The  mid-course  guidance  system  is  in  general 
composed  of  groiinded  based  radars,  command  and  control 
elements;  aircraft  display  and  control  systems,  and 
communications  equipment. 

4.6.2. 3 ACES  Function 

The  intent  of  the  ACES  program  is  to  develop, 
integrate  and  deploy  in  a modular  growth  sequence  an 
operational  GCI  intercept  simulator  system  to  establish 
a multi-purpose  GCI  operational  "Test  Bed."  The  initial 
phase  of  this  progreun  is  to  develop  equipment  replicat- 
ing the  communications  equipment  with  a companion 
Electronic  Warfare  Scoring  System  to  assess  the  impact 
of  communications  countermeasures  upon  the  GCI  process. 
The  associated  figure  depicts  the  ACES  program  elements 
including  a proposed  EW  scoring  system. 

4. 6. 2. 4 Program  Phases 

Follow-on  phases  of  the  ACES  program  would  encom- 
pass development  and  integration  of  systems  for  aircraft 
and  ground  based  equipment.  Specifically,  these  elements 
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Figure 


include  manned  command  and  control  equipment,  cockpit 
displays  and  existing  threat  radar  systems  integration. 

4. 6. 2. 5 OTT&E  Integration 

Upon  completion  of  the  ACES  development  program, 
utilization  of  the  existing  USAF  air  combat  mcineuvering 
instrumentation  (ACMI)  and  associated  simulated  weapons 
systems,  end-game  analysis  incorporating  up  to  20 
participants  would  be  possible. 

4 . 6 . 2 . 6 Conclusion 

The  ACES  program  would  provide  a threat  simulator 
capcibility  not  presently  available  for  operational  uss 
in  any  comprehensive  operational  form. 

4.6.3  Scoring  for  Simulated  Launch/Release 
(Figures  4-9,  4-10,  4-ll,  4-l2  and  4-13) 

4. 6. 3,1  Introduction  and  Scoring  Definitions 

The  goal  of  this  segment  is  to  provide  a capability 
to  score  simulated  launches/releases.  Again  the 
process  starts  with  the  requirements  definition  phase. 
This  phase  identifies  what  the  range  user  will  ask  the 
instrumentation  to  provide  and  what  decisions  will  be 
made  based  on  the  answer.  Included  in  this  phase  is  the 
basic  choice  of  an  acceptable  scoring  technique.  Four 
types  of  scoring  for  simulated  weapons  have  evolved 
historically;  they  are  described  below  in  generally 
ascending  order  of  accuracy,  complexity,  and  cost. 

a.  Exposure  Envelope  Scoring.  Basically, 
exposure  envelope  scoring  records  tne  time  intervals 
in  a mission  during  which  any  given  target  is  within 
the  line-of-sight  of  an  given  threat.  The  threats  may 
include  observers,  acoustic  sensors,  radars,  lasers, 
etc.  Sophistication  may  be  added  by  requiring  the 
target  to  be  within  a given  range  of  the  threat,  or 
within  a given  range-altitude-relative  velocity  envel- 
ope. Whatever  these  added  requirements,  they  would  be 
imposed  to  simulate  sensor  capabilities  and/or  the 
limitations  of  threat  weapons  associated  with  the 
sensors.  Exposure  envelope  scoring  is  thus  a very 
simple  method  of  simulating  weapons  effects.  This 
method  requires  little  or  no  special  equipment  and  is 
low  cost. 
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b.  Miss-Distance  Scoring.  There  are  two  clas- 
sifications  ofmiss-distance  scoring.  In  scalar  miss- 
distance  scoring,  the  minimum  distance  between  the  fired 
weapon  and  the  target  as  they  pass  each  other  is  the 
measure  of  effectiveness  (the  "miss-distance").  This 
includes  zero  miss  distance  for  a weapon  hitting  the 
target,  and  it  includes  the  target-to- impact  point 
distance  for  an  impact-detonated  weapon  aimed  at  a ground 
target.  Vector  miss-distance  scoring  provides  the  weapon 
velocity  vector  and  the  miss  distance. 

For  scalar  miss-distance  scoring,  the  miss-distance 
value  itself  could  be  the  measure  of  effectiveness. 
Ordinarily,  however,  the  miss-distance  will  be  related  to 
a weapon  lethality  radius,  probably  without  regard  for 
target  vulnerability  characteristics,  and  the  weapon  will 
be  considered  successful  if  and  only  if  its  target 
miss-distance  is  less  than  the  predetermined  lethal- 
ity radius. 

The  weapon  would  be  considered  successful  in  vector 
miss-distance  scoring  if  the  miss-distance  and  relative 
velocity  vector  fall  within  a pre-determined  lethality 
envelope.  The  lethality  envelope  is  a product  of  the 
lethality  radius,  or  more  properly:  the  lethality 

geometry  of  the  warhead;  the  velocity  of  the  missile;  the 
aspect  angle  of  the  missile  in  relation  to  the  target; 
and  the  vulnerability  of  the  target.  Each  of  these  ingre- 
dients can  be  neglected,  generalized,  or  detailed  de- 
pending on  the  sophistication  of  the  simulation.  Greater 
operational  cost  and  more  complex  equipment  cind  soft- 
ware are  attendant  on  the  more  sophistication.  How- 
ever, more  realism  is  attained  with  more  sophistica- 
tion. 

c.  Kill-No  Kill  Scoring.  This  type  of  scor- 

ing consists  of  separating  each  weapon-target  inter- 
action into  two  mutually  exclusive  categories:  (1) 

the  target  is  completely  undamaged  and  unaffected,  and 
(2)  the  target  is  killed  immediately.  The  mechanism 
for  making  this  separation  is  subsidiary  to  the  rigidity 
of  the  categories.  Kill-no  kill  scoring  may  differ 
from  miss-distance  scoring  only  in  that  the  words 
"successful"  and  "unsuccessful'"  are  replaced  respec- 
tively by  "killed"  and  "not  killed."  If  more  realism 
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is  desired,  fuze  activation  time  may  be  used  to  determine 
the  location  of  the  warhead  at  detonation;  warhead 
blast  and  fragmentation  effects  at  the  target  may  be 
determined  by  considering  air  properties  at  altitude, 
weapon  and  target  relative  aspects;  and  relative 
velocities  may  be  added  vectorial ly  to  detonation~ 
produced  blast  wave  and  fragment  velociites.  These 
quantities  may  then  be  applied  to  a geometrically- 
detailed  target  vulnerability  model  to  assess  target 
damage.  The  kind  of  relationships  involved  are 
graphically  illustrated  in  Figure  4-14.  At  this 
point,  the  results  may  be  as  realistic  as  concrete 
knowledge  permits,  but  some  realism  will  be  neces-' 
sarily  lost  when  the  target  damage  assessment  is  con- 
verted to  a kill-no  kill  scoring  choice,  rather  than 
acknowledging  the  range  of  possibilities  noted  in  the 
follo’wing  section, 

A distinct  advantage  of  kill-no  kill  scoring  applies 
to  OT&E  scenarios  for  which  kill  removal  is  desired  to 
enhance  the  realism  of  simulated  combat.  The  target  is 
either  quickly,  completely  removed  by  a weapon,  or  it 
continues  its  mission  at  its  original  performance  level. 
There  are  thus  no  requirements  for  wiring  equipment  to 
simulate  partial  failure,  or  for  training  operators  to 
perform  as  if  their  equipment  were  partially  damaged. 

d.  Damage  Assessment  Scoring.  This  scoring, 
ideally,  talces  advantage  of  all  the  sophistication 
built  into  real  weapons  and  computerized  end-game 
simulations  to  estimate  the  degree  and  kinds  of  deunage 
imposed  upon  a given  target  by  a given  weapon.  Damage 
assessment  scoring  in  these  cases  will  be  most  mean- 
ingful if  the  end-game  simulation  is  the  detailed  type 
mentioned  in  the  preceding  discussion  on  kill-no  kill 
scoring. 

Within  this  scoring  category,  two  approaches  may  be 
applied.  In  the  first,  immediate  damage  assessment 
scoring,  the  degree  of  target  subsystem  destruction 
directly  caused  by  the  weapon  v/ould  be  determined. 

That  dams-go  would  be  translated  into  a "continue 
mission"  signal,  possibly  specifying  reduced  perform- 
ance, or  signals  such  as  "killed"  or  "return  to  base" 
co’uld  be  given.  Scoring  would  then  be  recorded,  and 
the  next  weapon-target  interaction  would  be  an  inde- 
pendent scoring  event. 
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In  the  second,  more  comprehensive  "delayed  damage 
assessment  scoring,"  the  scoring  computer  would  track 
the  partially  damaged  target,  determining  if  damage 
propagated  later  was  due  to  newly-imposed  mission  ' 
stresses,  or  adding  damage  from  subsequent  weapons 
to  that  of  the  first.  Appropriate  damage  or  kill 
messages  could  thus  be  addressed  to  the  system  opera- 
tor at  any  time  during  the  mission  after  the  first 
weapon  detonation.  Delayed  damage  assessment  scoring 
is  thus  the  most  realistic  possible  scoring  short 
of  actual  combat. 

There  appear  to  be  two  major  disadvantages  to 
d^age  assessment  scoring.  First,  compared  to  other 
scoring  methods  it  requires  the  most  detailed  weapons 
and  target  data  as  input  as  well  as  the  largest  com- 
puter facilities  to  mechanize.  Second,  the  scoring 
reBults  are  realistically  varied  and  therefore  more 
difficult  to  evaluate  than — say — "killed"  or  "not 
killed."  Both  of  these  considerations  imply  increased 
expense  and  facilities  compared  to  simpler  scoring 
techniques.  The  costs  and  facilities  required  for  the 
highly  sophisticated  scoring  approach  must  be  balanced 
with  those  required  for  a moderately  sophisticated  or 
even  a simple  approach  while  still  providing  the 
required  evaluation  base  for  a multi-million  dollar 
OT&E  scenario. 


4 . 6 . 3 . 2 Accuracy  Requirements 

The  next  step  is  to  translate  these  operationally 
oriented  requirements  into  instrumentation  requirements 
defining  the  measurements  that  must  be  made  and  to  the 
degree  of  accuracy  needed  to  answer  the  operational 
questions.  Establishing  final  instrumentation  accuracy 
requirements  that  will  satisfy  operational  needs  and  yet 
are  technically  achievable  is  the  most  critical  part  of 
this  process.  The  influences  of  instrumentation  inac- 
curacies in  simulated  soaring  are  depicted  graphically 
in  Figures  4-15,  4-16,  and  4-17. 

a.  Accuracy  Requirements  for  Unguided  Weapons.- 
The  Dikewoo’d  CJorporation,  TESPO's  Systems  Engineering 
and  Technical  Assistance  (SETA)  contractor,  has  com.- 
pleted  studies  entitled  "Aircraft  Flight  Parameter 
Accuracy  Requirements  for  Scoring  Simulated  Air-to-Ground 
Unguided  Weapons  Deliverys,"  and  "Dispersion,  Tra- 
jectory and  Accuracy  Considerations  for  Scoring 
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Figure  4-16 


Simulated  Gun  Bursts  in  Air  Combat."  These  studies 
were  accomplished  to  provide  tools  for  relating  a 
desired  simulated  unguided  weapon  impact  point  accuracy 
to  the  required  accuracies  to  which  launch  platform 
attitude  and  flight  parameters  must  be  known  by  the 
instruraentation  system  at  the  instant  of  simulated 
weapons  launch. 

b.  Scoring  System  Characteristics  for  Unguided 
Weapons . WorTc  accomprislhed  so  iar  has  identified 
erght  important  characteristics  that  the  nature  of  test 
and  training  scenarios  impose  on  any  scoring  system 
(SS)  designed  to  score  simulated  weapons  launches. 
These  are; 

- Participants  must  be  defined  as  attackers, 
targets,  or  composites  (interchange  of  roles)  be- 
fore the  scenario  starts. 

- The  weapons  used  must  be  identified  to  the 
SS  before  they  are  fired. 

- The  SS  should  allow  each  participant  to  inter- 
act with  all  the  other  participants  according  to  its 
role  in  the  scenario. 

- Individual  variations  in  weapon  trajectories 
(including  MG  and  cannon  bursts) , fuse  behavior,  and 
warhead  fragment  trajectories  may  never  be  predicted 
deterministically. 

- Preaveraging  the  statistical  variations  in 
th<3  above  paragraph  eliminates  realistic  considerations 
of  manufacturing,  launching,  and  warhead  variations 
which  are  important  to  actual  combat, 

- Target  damage  may  be  negligible,  immediate, 
or  delayed. 


- The  SS  should  have  general  scoring  programs 
with  weapon  and  target  characteristics  packages  added 
for  individual  scoring  calculations. 

- Checks  should  be  made  to  assess  accidental 
weapon  deimage  to  scenario  participants  which  are  not 
directly  invovled  in  a local  engagement. 
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Figure  4-18  is  a simplified  functional  diagreim 
of  an  instrumentation  system  designed  to  score  simu- 
lated releases/launches  of  unguided  weapons.  Note 
that  output  locations  for  the  types  of  scoring  results 
defined  in  4. 6. 3.1  are  shown  in  this  figure. 

c.  Guided  Weapons.  TESPO  has  sponsored  further 
study  effort  through  the  SETA  contractor  into  the 
feasibility  of  simulating  the  trajectory  of  self  guided 
weapons  in  real  time  as  a part  of  a scoring  system  for 
simulated  laucnches.  This  study  concentrated  on  the 
family  of  missiles  and  "smart  bombs"  that  fall  into  the 
"launch  and  leave"  category.  Examples  are  the  Maverick, 
Walleye,  and  Standard  Arm.  The  scoring  calculations  for 
such  weapons  are  much  more  complex  than  those  for  un- 
guided weapons  since  guided  weapons  respond  to  com- 
plex environmental  effects  during  flight.  When  jamming 
energies  are  added  to  the  guided  weapons  environment, 
the  simulation  problem  becomes  even  more  complex. 

The  framework  of  the  study  was  based  on  the 
following  outline: 

1)  Relative  trajectories  and  orientations  of 
attacker  and  target  (single  or  group)  during  the  begin- 
ning of  the  engagement, 

- Attacker  look  angles  and  received  jamming 
power  (single  or  multiple  sources) . 

- Target  (single  or  group)  acquisition  process 
with  jamming. 

- Attacker  weapon  lock-on  problem  with  jamming. 

• - Attacker  and  target  identifications  to  scoring 

system. 


2)  Attacker  and  target  trajectories  and  orienta- 
tions at  weapon  launch. 

- Weapon  Launch  perturbations. 

- Weapon  lock-on  problem  with  jamming. 

- Weapon  initial  trajectory  and  orientation 
with  respect  to  target. 
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3)  Weapon  guidance  with  janmiing  and  the  result- 
ing trajectory  toward  target. 

- The  possibility  of  acquiring  a decoy  or  a 
different  target  in  flight. 

- Selection  of  a single  target  if  the  weapon 
was  originally  aimed  at  a group. 

- Embedded  problem:  simulation  of  antimissile 

missiles  or  antimissile  machine-gun  rounds  (e.g.,  U.S.). 

4)  Terminal  Homing  Phase. 

- Weapon  terminal  guidance  with  jamming  or 
nearby  radiating  objects. 

- Weapon  fuze  operation  with  jamming  or  nearby 
radiating  objects. 

5)  Target  Damage  Assessment. 

- Weapon  and  target  trajectories  and  orienta- 
tions at  burst. 

- Blast  and/or  fragment  effects  on  a distributed 

target. 


- Weapon  penetration  of  target  before  burst, 

- Possible  damage  to  objects  near  the  target. 

The  above  outline  will  apply  equally  to  air-to- 
ground,  groiind-to-air,  and  air-to-air  self-guided  weapons. 
However,  this  list  of  simulation  problems  is  given  for 
one  attacker  launching  one  weapon  at  a single  target. 

It  is  reasonable  to  expect  a scoring  system  to  be 
capable  of  handling  multiple,  simultaneous  launches 
toward  separate  targets  as  well  as  launches  by  the 
targets  toward  the  attackers. 

Figure  4-19  is  a simplified  flow  diagram  of  the 
general  guided-weapon  simulation  scheme.  The  output 
points  for  the  hierarchy  of  scoring  results  established 
earlier  are  again  shown  in  this  figure. 
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Figure  4-19 
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d.  Results.  The  results  of  this  study  effort 
can  best  be  suirtmarized  by  estimating  what  is  required 
to  complete  various  portions  of  the  simulation  effort. 

1)  Considerable  work  has  been  completed  on 
simulations  of  weapon  thrust,  aerodynamics,  aerodynamic 
stability,  and  trajectories.  Very  little  additional 
effort  would  be  required  to  incorporate  this  work  into  a 
real  time  scoring  system. 

2)  The  weapon  guidance  and  jamming  inter- 
actions would  require  moderate  effort  to  simulate. 

3)  Target  vulnerability,  weapon  blast, 
fragmentation  effects,  and  target  damage  assessment 
require  extensive  effort  to  adequately  simulate. 

4. 6. 3. 3 Conclusions 

a.  Unguided  Weapons.  Tools  have  been  devel- 
oped to  translate  accuracy requirements  for  the  miss 
distance  determination  of  simulated  weapons  releases  to 
position  and  flight  parameter  measurement  accuracies 

of  the  launch  platform.  Once  the  requirement  analysis 
process  has  established  the  miss  distance  requirements, 
TESPO  can  specify  the  instrumentation  needed  to  satisfy 
these  requirements. 

b.  Self-Guided  Weapons.  The  amount  of  effort 
needed  to  complete  a satisfactory  simulation  of  this 
class  of  weapons  indicates  that  an  envelope  scoring 
approach  be  used  in  at  least  the  initial  effort  to  meet 
the  requirements  of  this  segment. 

4.6.4  Time-Space-Postion  Information  (TSPI) 

Systems  (Figures  4-20  and  4-2T) 

In  the  TT&E  improvement  program,  TSPI  require- 
ments may  vary  considerably  between  the  various  ranges/ 
sites  selected  for  improvement.  Therefore,  this  section 
addresses  the  generic  categories  of  TSPI  and  the  techni- 
ques available  to  meet  the  requirements  of  each  of  these 
categories. 
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4 . 6 . 4 . 1 General 

The  general  requirements  for  TSPI  can  be  divided 
into  three  categories;  area  surveillance,  terminal  area 
TSPI,  and  TSPI  for  scoring  purposes.  The  distinction 
between  the  first  two  categories  is  fairly  clear;  a 
requirement  exists  for  air  surveillance  over  a wide  area 
(extending  beyond  range  boundaries)  of  both  cooperative 
and  noncooperative  aircraft  for  purposes  of  test  mon- 
itoring, air  traffic  control,  and  safety  functions. 

These  requirements  are  characterized  by  high  capac- 
ity but  relatively  low  resolution  and  low  accuracy. 

Within  a terminal  (attack)  area,  where  high  maneuver- 
ability and/or  formation  flying  may  be  expected,  a 
requirement  is  seen  for  higher  resolution  and  accuracy 
on  a few  aircraft  (normally  four  aircraft  simultaneously 
in  a terminal  area)  , which  could  be  expected  to  be  •'co- 
operating" in  the  particular  mission. 

The  division  between  terminal-area  TSPI  and  TSPI 
for  scoring  is  less  distinct,  and  is  dependent,  to  a 
large  degree,  upon  what  is  meant  by  "scoring."  A long- 
term goal  of  TT&E  improvements  may  be  a capability  to 
"score"  entire  missions  or  engagements,  on  the  basis  of 
the  casualties  ("kills")  of  equipment  on  both  sides--thus 
generating  the  requirement  for  real-time  simulation  of 
A/G,  G/A,  and  A/A  weapon  trajectories,  so  that  "dead" 
elements  could  not  (unrealistically)  continue  to  influence 
the  final  outcome.  However,  for  the  next  few  years  at 
least,  some  less  elaborate  technique  for  scoring  multiple- 
participant  encounters  may  be  advisable.  Approaches 
under  consideration  are;  performance  measures  based 
on  exposure  time  (such  as  has  been  used  at  Eglin  in 
CORONET  ORGAN  exercises) — which  would  draw  upon  both 
terminal  and  wide-area  surveillance  TSPI  sources;  weapon 
•'envelope"  scoring — ’for  which  the  terminal  area  TSPI 
might  be  adequate,  at  least  for  a large  class  of  self- 
guided  (homing)  weapons;  and  single-target  character- 
istics. This  list  is  not  all  inclusive,  but  it  does 
demonstrate  the  spectrum  of  techniques  available. 

Surveillance  Systems.  Area  surveillance 
is  required’  over  the'  entire'  'range,  or  sometimes  even 
beyond  the  boundaries  of  the  range,  for  the  purpose 
of  test  monitoring,  air  traffic  control,  detection  of 
non-participating  aircraft  which  intrude  upon  an  exercise, 
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or  for  limiting  activities  of  aircraft  to  locations 
designated  in  the  interests  of  range  safety.  Surveil- 
lance systems  are  characterized  by  large  coverage 
volumes/  modest  accuracy  requirements  and  the  necessity 
for  handling  large  numbers  of  aircraft  simultaneously. 

For  the  wide-area  surveillance  function,  an  obvious 
candidate  is  the  currently  existing  PAA  network  of 
primary  and  IFF/  SIF  radars,  exploiting  the  ATCRBS 
transponders  already  aboard  virtually  all  military  and 
commercial  civilian  aircraft.  Augmentation  of  FAA 
coverage  in  any  range  area  by  the  addition  of  Air  Force 
search  or  surveillance  radars  and  IFF  interrogators  may 
be  necessary,  particularly  at  low  altitudes  and  on 
aircraft  not  equipped  with  ATCRBS  transponder.  Other 
candidates  may  require  similar  interaction  of  exist- 
ing systems . 

b.  Terminal  Area.  The  terminal  area  is  that  in 
which  engagements  between  aircraft-and-aircraft  or 
aircraft-and-ground  targets  or  various  combinations  of 
these  events  take  place.  A surveillance  system  depends 
upon  aircraft  flying  a regularly  ordered  course  in 
response  to  ground  direction  and  thus  can  relax  accuracy 
and  sampling  time  requirements  because  the  aircraft  path 
is  predictable.  In  constrast,  in  the  terminal  area, 
simulation  of  combat  events  results  in  frequent  unpre- 
dictable maneuvers  and  consequently  considerably  increased 
accuracy  over  that  required  for  surveillance  systems  is 
needed.  On  the  other  hand,  the  coverage  volume  of  such 
systems  is  much  less  than  for  surveillance  systems  and 
the  number  of  simultaneous  participants  is  much  smaller. 
Multilateration  techniques  offer  the  most  promise  for 
terminal-area  TSPI  of  medium  accuracy  (on  the  order  of 
50  ft  RMS  error) . Several  proven  and  operational 
systems  are  availcible,  all  of  which  involve  the  use  of  a 
cooperative  transponder  carried  in  a weapon-shape  pod  by 
the  participating  aircraft.  These  include  the  Cubic 
ACMR,  the  General  Dynamics  RMS,  and  the  IBM  ALSS.  As 
another  alternative  for  low-density  situations,  exploita- 
tion of  IFF/SIF  multilateration  technique  such  as 
proposed  in  the  Sierra  Research  HAILS  (High  Accuracy 
Instrimentation  and  Location  System)  proposal  has  merit, 
as  a medium- accuracy  terminal  TSPI  system  which  would 
require  no  aircraft  pods. 
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c.  Scoring  Systems.  Scoring  systems  measure 
the  effectiveness  of  a weapon  directed  against  a target. 
The  situation  may  be  air-to-air  (aircraft  engaged  in  a 
dog  fight  and  firing  weapons  at  each  other) , air-to- 
ground  (bombing,  strafing,  firing  of  ARMs,  etc.), 
gro\ind-to-air  (SAM  missiles)  or  ground-to-grovind 
(artillery).  The  distinction  between  terminal  TSPI 
and  scoring  systems  is  somewhat  blurred,  since  terminal 
systems  are  used  for  evaluation  of  the  engagement  and 
thus  represent  "scoring"  of  the  exercise.  Scoring 
systems  are  usually  associated  with  real  or  simulated 
one-on-one  engagements  where  high  accuracy  is  required 
to  determine  miss-distance,  probability  of  kill,  or 
entrance  into  a kill  envelope.  Less  accurate,  wider 
range  systems  are  placed  in  the  terminal  TSPI  category. 

4. 6. 4. 2 Measurement  Systems 

a.  Single  Point  System.  Single  point  position 
measuring  systems  make  use  of a single  measurement 
station  in  which  the  position  of  a target  is  determined 
by  measuring  range  to  the  target  and  azimuth  or  azimuth 
and  elevation  angles.  Single  point  systems  typically 
consist  of  radar  or  laser  system  since  only  these 
systems  permit  range  measurement.  Single  point  systems 
which  measure  both  azimuth  and  elevation  angle  can 
consist  either  of  a single  radar  or  of  separate  azimuth 
and  height  finding  radars. 

b.  Distributed  Sensor  Systems.  Distributed 
sensor  systems  consist  of  two  or  more  measurement 
sensors  located  some  distance  from  each  other.  Each 
sensor  makes  a measurement  of  target  angle  and/or  range 
and  then  a mathematical  computation  is  used  to  extract 
target  position. 

4 . 6 . 4 . 3 Range  Measurement  Techniques 

a.  Pulse  Ranging  Techniques.  A pulse  of  energy 
is  transmitted  which  is  reflected  from  the  target. 
Measurement  can  be  made  by  use  of  the  leading  or  trail- 
ing edges  of  the  pulse  or  a derived  centroid. 

b . CW  or  Phase  Comparison  Ranging.  Range 
information  is  extracted  from  the  reflected  signal 

by  measuring  the  phase  difference  between  transmitted 
and  reflected  waveforms. 
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c.  Doppler  Effect  Range  Measurement.  Moving 
targets  disturb  the  reflected  waveform  in  time  and 
change  the  frequency  of  the  transmitted  signal  by  a 
doppler  frequency  proportional  to  velocity.  Use  of  thi^ 
doppler  frequency  can  be  made  to  obtain  target  velocity 
and  ranging. 


4. 6. 4. 4 Angle  Measurement  Techniques 

a.  Mechanical  Angle  Measurement . The  most 
common  technique  for  obtaining  angle  measurements  is  to 
determine  the  axis  of  the  tracking  system,  point  the 
axis  at  the  target  to  be  measured,  and  then  measure  the 
angles  between  the  axis  and  reference  coordinates. 

b.  Interferometry  ^gle  Measurement.  Use  is 
made  of  several  antennas  along  a common  baseline  and 
measuring  the  phase  difference  in  signals  arriving  at 
each  antenna. 

c.  Monopulse  Tracking.  Monopulse  tracking 
involves  the  use  of  offset  beams  whose  signal  returns 
are  combined  to  produce  the  sum  and  difference  signals 
which  are  multiplied  together  to  produce  an  error  output 
which  is  used  to  precisely  reposition  the  antenna  mount. 
Angle  encoders  on  the  antenna  are  then  used  for  angle 
measurement. 

d.  Phased  Array.  By  mounting  a number  of  dipole 
antennas  in  a properly  spaced  array,  a composite  pattern 
resulting  from  the  summed  contributions  of  all  of  the 
dipoles  can  be  generated  which  is  dependent  upon  rela- 
tive signal  phase.  The  result  is  a narrow  signal  beeim 
which  can  be  used  for  tracking.  Computation  of  relative 
element  signal  phases  can  be  used  to  determine  angle  ' 
measurement. 

e.  Mult ilateration . Three  stations,  measuring 
slant  range  to  a target,  are  sufficient  to  establish 
target  coordinates.  In  practice  more  stations  are 
arranged  in  the  system  grouping,  and  computation  is 
performed  to  determine  and  use  stations  giving  best 
angular  position  (ideally  at  the  apexes  of  an  equi- 
lateral triangle)  . For  non-radar  tr ilateration.,  a ' 
cooperative  target  transponder  is  required  to  determine 
transit  time  and  derived  slant  range. 
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f.  Time  Difference  of  Arrival.  A receiver 
is  used  to  pick  up  signals  from  a pair  of  stations 
whose  positions  with  relation  to  each  other  are  known. 

The  receiver  measures  the  difference  between  the  time  of 
arrival  of  the  signals  and  from  the  two  stations  which 
is  a measure  of  the  difference  in  range  from  the  receiver 
to  the  two  stations.  Additional  stations  (minimum  of 
four  total)  are  used  for  computation  of  three  dimen- 
sional position. 

4 . 6 . 4 . 5 Equipment  Listing 

Detailed  descriptions  of  TSPI  systems  and  associated 
considerations  are  contained  in  2FTP  - H0386005,  "Survey 
and  Information  for  Selection  of  Time-Space-Position 
Information  Systems  for  USAF  OTT&E,"  AFSWC/TE,  Kirtland 
AFB,  New  Mexico,  June  1975.  A partial  equipment  matrix, 
extracted  from  that  document  is  included  on  Table  4.2. 

4. 6.4.6  Conclusion 

A TSPI  study  is  being  published  as  a separate 
volume  entitled,  "Survey  and  Information  for  Selection 
of  TSPI  for  USAF  Operational  Training,  Testing  and 
Evaluation  (OTT&E),"  2FTP  - H0386005.  The  first  portion 
of  this  volume  presents  75  TSPI  systems  which  are  cur- 
rently conceptual,  developmental,  or  operational  stages. 
These  systems  are  a representative  cross  section  of  all 
major  techniques  for  obtaining  Time-Space-Postion 
Information.  The  report  provides  a brief  description 
each  system,  descriptions  of  the  basic  operating  princi- 
ple for  each  system  and  discussions  of  the  various 
problems  and  sources  of  error  which  may  be  encountered. 
This  first  portion  of  the  volume  is  meant  to  serve  as  a 
basic  reference  document  for  selecting  TSPI  systems  for 
individual  TT&E  improvement  projects. 

The  second  portion  of  the  volume  determines  TSPI 
requirements  for  fifteen  generalized  missions  that  form 
a cross-section  of  OTT&E  activities  of  the  Air  Force 
over  the  next  ten  years.  Matrices  are  provided  to 
demonstrate  how  particular  TSPI  systems  are  applicable 
to  particular  mission  test  requirements.  This  survey 
provides  a basis  for  developing  the  performance  speca.fi- 
cations  for  obtaining  the  necessary  TSPI  system,  whether 
through  improvement  of  existing,  on-range  equipment, 
procurement  of  a system,  or  further  improvement  of  TSPI 
system  technology. 
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TSPI  CANDIDATES 


♦Relative  position  and  altitude  measurement. 
**Not  available  until  after  1978. 
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4.6.5  ACMI  (Figure  4-22) 

4. 6. 5.1  Background 

The  initial  ACMI  requirement  is  for  the  capability 
to  monitor  and  score  air-to-air  combat  training.  The 
ACMI  must  be  capable  of  identifying  and  tracking  a 
specified  number  of  participants;  determine  attitude, 
position,  absolute  and  relative  velocities;  record 
firing  actions  and  hit  or  miss  distances  for  inventory 
aircraft-weapon  combinations;  display  activity  in 
real-time  for  safety,  control  and  optimization  of 
training;  and  record  parameters  for  a full  playback 
presentation.  This  system  must  perform  these  functions 
with  minimum  modifications  to  aircraft. 

4 . 6 . 5 . 2 Current  ACMI  Status 

Equipment  is  presently  in  operation  which  is 
capable  of  such  performance.  Acquisition  of  ACMI 
capable  of  air-to-air  training  functions  must  be  viewed 
in  conjunction  with  the  future  requirements  for  precise 
weapon  scoring  to  permit  the  use  of  the  "building- 
block"  acquisition  scheme. 

The  ACMI  system  to  be  procured  for  the  Nellis 
Range  is  based  upon  previous  Navy  development  and 
follows  the  concept  of  equipment  commonality.  Ground 
stations  are  remoted  and  require  minimum  personnel 
support  while  the  airborne  instrumentation  pod  is  to  be 
designed  for  "blue  suit"  operation  and  maintenance. 
Centralized  procurement  of  this  initial  AF  system  in 
conjunction  with  the  U.S.  Navy  will  insure  compat- 
ibility between  DOD  users  and  allow  multi-service  use 
of  such  systems. 

The  initial  Nellis  system  will  cover  a 30  to  40  NH 
diameter  vertical  cylinder  of  airspace  with  the  capa- 
bility of  diameter  expansion  by  the  addition  of  more 
ground  stations.  The  feasibility  of  integration  of 
ACMI  with  TSPI  will  require  study  based  upon  range 
user  identified  requirements. 
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4.6.6  Ordnance  Scoring.  (Figures  4-23,  4-24  and 

4-25) 

The  goal  of  this  segment  is  to  discuss  the  scoring 
of  real  weapons,  inert  and  live,  and  to  suggest  suit- 
able scoring  systems  from  among  those  presently  avail- 
able. Air-to-air,  air-to-ground,  and  ground-to-air 
weapons  will  all  be  considered. 

4. 6. 6.1  General 


Scoring  of  real  munitions  can  be  based  on  cooperative 
or  non-cooperative  systems.  Cooperative  systems  require 
that  some  device  (refelctor,  beacon,  telemetry  trans- 
mitter, etc.)  be  installed  on  the  weapon  being  scored. 
Non-cooperative  systems  do  not  require  an  on-board 
tracking  aid.  For  actual  launches  (or  drops) , a non- 
cooperative  scoring  system  is  desirable.  Factors 
against  cooperative  systems  are  the  destruction  of  any 
on-weapon  instrumentation,  the  difficulties  in  instru- 
menting some  weapons  (MG,  cannon,  small  rockets) , and 
the  use  of  small  practice  bombs  to  simulate  actual 
bombs.  Cooperative  systems  can  be  put  on  guided  mis- 
siles, guided  bon±)S,  and  the  larger  unguided  weapons; 
however,  this  would  constitute  modification  of  the 
operational  system,  loss  of  the  instrvimentation  with 
each  launch  test,  and  could  reduce  realism. 

Of  the  four  scoring  techniques  discussed  in  4. 6. 3.1, 
miss-distance  scoring,  kill-no  kill  scoring,  and  damage- 
assessment  scoring  are  appropriate  for  real  weapons. 
Miss-distance  scoring  especially  applies  to  real,  live 
weapons;  e.g.,  live  cannon  rounds  missing  an  airborne 
target.  For  real,  live  weapons,  damage-assessment 
scoring  is  most  appropriate  if  the  target  damage  can  be 
inspected  after  weapons  firings  are  determined.  Kill-no 
kill  scoring  then  becomes  two  special  cases  under 
dcimage-assessment  scoring.  If,  however,  the  target  is 
not  available  for  post-shot  inspection,  arbitrary  rules 
will  be  required  to  impose  kill-no  kill  scoring  on  the 
effects  of  real,  live  weapons.  Missile  effectivness 
against  an  aerial  drone  flying  over  water,  for  example, 
might  simply  be  decided;  "kill"  if  the  drone  is  falling 
out  of  control  within  ten  seconds  of  missile  detonation, 
"no-kill"  otherwise. 
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4. 6. 6. 2 Technical  Principles  Used  to  Score 
Real  Ordnance 

A companion  document,  2FTP  - HO 386005,  "Survey 
and  Information  for  Selection  of  TSPI  for  USAF  Opera- 
tional Training,  Testing  and  Evaluation  (OTT&E)," 
discusses  in  detail  the  engineering  principles  used  in 
existing  scoring  systems  for  real  ordnance  applications. 
The  most  successful  of  these  principles  are  sketched 
briefly  here: 

a.  Radio  Frequency  (RF) . Microwave  and  radar 
systems  are  used  for  miss  distance  or  impact  scoring  by 
trajectory  tracking.  The  accuracies  and  relatively 
short  effective  ranges  of  these  devices  dictate  the  use 
of  scoring  systems  specifically  developed  for  this 
purpose.  These  are  non-cooperative  systems  in  most 
cases  in  which  bomb  and  missile  live  deliveries  are 
evaluated. 


b.  Optical.  Video  and  film  recording  have 
been  used  for  real  launches.  Some  systems  use  video 
techniques  for  scoring  bombs,  rockets,  and  larger  guns 
(e.g.,  Celesco  LAROSS) . In  some  cases,  near  real-time 
evaluations  are  possible.  Post-flight  analysis  of  both 
video  and  film  recordings  is  most  common.  These 
systems  provide  an  automated  means  to  count  and  survey 
the  deliveries.  A permanent  recording  is  obtained  and 
fine-grained  analysis  is  possible.  Film  processing, 
play-back  equipment,  software,  and  film  storage  are 
drawboicks  to  these  systems.  Machine  gun  and  cannon  fire 
cannot  be  scored  with  these  systems  unless  a dirt  or 
water  splash  is  used;  however,  this  technique  does  not 
provide  the  accuracy  needed. 

Lasers.  Scoring  bombs,  missiles,  and  other 
weapons  by  laser  techniques  are  essentially  identical  in 
principle  to  RF  scoring  systems  except  that  some  reflec- 
tion cooperation  between  the  weapon  and  scoring  device 
may  be  required.  Laser  techniques  offer  the  advantages 
of  no  RF  emissions  and  greater  accuracy  than  comparable 
RF  techniques. 
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d.  Acoustic.  Acoustic  systems  rely  on  the 
souhd  of  impact  or  burst.  Variations  in  the  speed  of  i 
sound,  other  soxind  generators  such  as  the  aircraft, 

and  rate  of  delivery  (MG  and  cannon)  are  primary  prob- 
lems in  use  of  these  systems. 

e.  Seismic.  As  the  weapon  impacts  the  ground, 
seismic  waves  are  generated.  Scoring  is  accomplished  by 
timing  the  signal  arrival  at  a number  of  surveyed 
sensors.  Aircraft  noise,  multiple  concurrent  deliveries, 
inconsistencies  in  terrain,  and  calibration  problems, 
all  tend  to  eliminate  these  systems  as  candidates. 

4. 6. 6. 3 Survey  of  Some  Existing  Systems  for 
Scoring  Real  Weapons 

Each  TSPI-like  and  scoring  system  described  in 
2FTP  - H0386005  has  been  reviewed.  Systems  designed 
to  score  simulated  weapons  deliveries  have  been 
eliminated,  as  have  surveillance  and  terminal  TSPI 
systems.  Finally,  real-weapon  scoring  systems  which  do 
not  give  results  in  (near)  real  time  were  omitted.  The 
reduced  list,  containing  only  near-real-time  systems  for 
scoring  real  weapons  deliveries,  inert  or  live,  is  given 
here  as  Table  4.3.  These  scoring  systems  have  ben 
further  categorized  according  to  their  possible  appli- 
cation to  Air-to-Ground,  Air-to-Air,  and/or  Ground-to- 
Air  weapons  deliveries.  (Table  4.4.) 

4. 6. 6. 4 Comment  and  Conclusions 

Inspection  of  Tables  4.3  and  4.4  shows  that  no  one 
scoring  system  will  be  suitable  for  real  guns  and  ® 

rockets,  missiles,  and  bombs  in  Air-to-Ground,  Air-to- 
Air,  and  Ground-to-Air  scenarios.  The  variety  of 
scoring  requirements  determines  that  multiple  procure- 
ments will  be  necessary  to  synthesize  an  all-weapon, 
all-scenario  scoring  system  for  real  ordnance. 

Neither  the  accumulation  of  TSPI-like  and  scoring 
systems  in  2FTP  - H0386005  nor  the  abbreviated  list  is 
exhaustive.  Further,  new  scoring  systems  are  being 
developed  and  proven  each  year.  Even  the  person  who 
wishes  to  test  one  type  of  weapon  in  one  type  of 
scenario  should,  therefore,  regard  the  information 
herein  as  an  aid,  and  he  should  investigate  other 
potential  scoring  systems. 
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TABLE  4.3:  NEAR-REAL-TIME  SCORING  SYSTEMS  FOR  REAL  WEAPONS 

(Reference  a) 


Paragraph 
in  Ref.  ® 

Scoring  System 

Page  in 
Ref.  a 

System 

Applications 

5.5.7 

AN/FPS-16  Precision  Tracking  Radar 

59 

Track  one  real  a/c, 
missile,  or  bomb 

5.5.10 

Phased  Array  Instrumentation  Radar 
(PAIR) 

61 

Track  100-200  a/c, 
missiles,  or  bombs 

5.5.14 

Cooperative  Doppler  Scoring  System 
(CODOPS) 

65 

Coarse  miss  distance 
for  one  a/a  missile 
passing  drone 

5.5.15 

Digidops  Scoring  System 

66 

Miss  distance  for 
one  a/a  missile 
passing  drone 

5.5.16 

Miss-Distance  Indicator  Systems 

67 

Fine  miss  distance 
for  one  a/a  missile 
passing  drone 

5.5.18 

Vector  Miss  Distance  Indicator  (VMDI) 

72 

Miss  distance,  fuze 
data,  velocities, 
angles,  calculated 
kill  probability  for 
missile  passing  drones 

5.5.19 

Miss  Distance  Radar  Tracking  and 
Scoring  System  (MIDI) 

73 

Miss  distances  of 
cannon  rounds  passing 
airborne  target 

5.5.20 

Octant  and  Zone  Gunnery  Scoring  System 

74 

Miss  distances  and 
octant  locations  of 
cannon  rounds  passing 
airborne  target 

5.6.1 

Bidops  Electronic  Scoring  System 

77 

Miss  distance  for 
one  a/a  missile 
passing  drone 

5.7.1 

Precision  Automated  Tracking  System 
(PATS) 

77 

Track  one  real  a/c, 
missile,  or  bomb 

5.7.2 

Laser  Vector  Miss  Distance  Indicator 
(VMDI) 

78 

Miss  distance,  rela- 
tive velocity  of  one 
weapon  air  or  ground 
target 

5.9.1 

Acoustiscore 

85 

Scores  impact,  loca- 
tions of  MG,  cannon 
rounds  in  a/g  strafing 
of  instrumented  target 
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TABLE 

Paragraph 
in  Ref. 

6.3.1 

6.3.5 

6.3.8 

6.3.9 

6.3.10 

6.5.10 
7,2.8 


4.3: 


KEAR-REAL-TIKE  scoring  SYSTt 


I sjt\  r\ 


:ML 


WEAPONS  (Cont.) 


(Reference  ) 


Scoring  System 

Multiple  Airborne  Target  Trajectory 
System  (MATTS) 


Real  Time  Cinetheodolite  Data  System 
(RTCDS) 

K 400  Cinetheodolite  and  Tracking 
System 

Light  Attack  Range  Optical  Scoring 
System  (LAROSS) 


Page  in  System 
Ref.  Applications 

90  Tracks  cooperative 

interceptor,  missile, 
target  to  provide 
vector  miss  distance 
missile  passing  target 

95  Computer-smoothed 

tracking  data  on  one 
air  vehicle 

98  Tracks  one  real  a/c, 

missile,  or  bomb 

98  TV-computer  system 

for  scoring  impact 
points  of  real, 
inert  bombs 


Video  Bomb  Scoring 


99  TV-computer  system 
for  scoring  impact 
points  of  real , 
inert  bombs 


Automatic  Scoring  System 

Point  of  Impact  Scoring  System  (POI)  174 


Scores  ground  impact 
points  of  real  air- 
delivered  weapons 

Impact  point  scoring 
of  real , live  a/g 
and  g/g  projectiles 
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4.6.7  Airborne  Instrumentation.  (Figure  4-26) 


TESPO  has  sponsored  a study  effort  through  the 
SETA  contractor  into  the  feasibility  of  generating  a 
common  data  point  in  tactical  aircraft.  This  study 
would  address  the  design  of  such  a capability  in  new 
aircraft  and  its  inclusion  in  an  avionics  up-date 
program. 

This  study  will  be  considering,  as  examples,  the 
following  aircraft:  F-16,  F-15,  A-10,  F-5  and  EF-111. 

The  establishment  of  a common  data  point  in  tactical 
aircraft  would  permit  the  collection  of  critical  informa- 
tion from  on-board  instriamentation.  Such  a capability 
for  extracting  this  data  would  eliminate  the  require- 
ment to  generate  many  of  the  same  types  of  information 
with  "add-on"  instriimentation  pods.  Such  information 
would  be  valuable  in  training  and  tactics  development 
and  monitoring  and  diagnosing  situations  which  arise 
in  combat. 


4. 6. 7.1  Standard  Airborne  Instnunentation  System 
(SAIS) . (Figure  4-^7) 

Development  of  a "Standard  Airborne  Instrumenta- 
tion System  (SAIS) " will  follow  as  a natural  conse- 
quence of  ACMI  procurement.  The  SAIS  pod  approach 
would  be  an  interim  solution  until  new  or  modifified 
aircraft  are  available  that  could  provide  the  desired 
information  from  a "common  data  point."  The  existence 
of  such  a data  point  would  allow  the  time  division 
multiplexing  of  the  already  formated  data  to  a down 
link  or  an  on-board  recorder.  The  SAIS  or  the  concept 
of  a common  data  point  will  reduce  the  number  of  re- 
quired instrumentation  pods. 

a.  As  a minimum,  the  SAIS  will  be  designed  to 
operate  with  RMS-2/score,  APX-95,  and  ACMI  type  ground 
systems.  The  SAIS  will  provide  highly  accurate, 
real-time  data  to  support  OTT&E  scoring  of  ground-to- 
air,  air-to-air,  and  air-to-ground  operations.  The 
data  to  be  provided  will  consist  of: 
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- Aircraft  attitude  and  dynamics. 

- Missile  and  fire  control  system  parameters  from 
each  selected  weapons  station. 

- Visual  indication  of  a "kill;"  i.e.,  smoke. 

b.  An  on-board  digital  recorder  is  used  to 
store  the  data  as  it  is  formated  and  time  tagged  by  the 
processor.  A down  link  is  also  available  to  transmit 
the  data  for  ground  display  as  in  a test/  training 
situation.  The  interchangeable  instrumentation  feature 
of  SAIS  will  allow  for  installation  of  such  systems  as 
AGM-65,  SRAM,  and  the  Pave  Strike  weapons. 

4 . 6 . 7 . 2 Utilization  of  Internal  Aircraft  Instru- 
mentation 


In  any  consideration  of  the  need  "to  improve  Air 
Force  capabilities  for  Operational  Test  and  Evaluation 
.(OT&E)  and  Training"  it-  is  natural  to  think  immediately 
of  the  several  test  ranges  where  the  Air  Force  conducts 
most  of  its  OT&E  and  training,  and  to  visualize  those 
patches  of  real  estate  dotted  with  more  and  better 
paraphernalia  for  measurement  and  data  collection;  i.e., 
tracking  devices,  telemetry  stations,  communications 
equipment,  computers,  displays,  etc.  These  items  are 
of  course  necessary,  and  increasing  the  quality  and 
quantity  of  such  equipment  obviously  enhances  the 
ability  of  the  Air  Force  to  perform  its  test  and  train- 
ing functions.  However,  in  the  preoccupation  with  the 
challenging  problem  of  accurate  trajectory  measurement 
(particularly  for  aircraft)  and  the  equipment  needed , for 
its  rapid  transmission,  processing  and  display,  another 
area  for  high-payoff  investment  in  improved  capability 
may  have  been  overlooked— namely , the  incorporation  of 
.technical  means  to  facilitate  testing  and  training  into 
the.  aircraft  themselves,  which  are  the  subject  of  opera- 
.tional  testing  or  training,  or  at  least,  the  vehicles 
-within  which  Air  Force  systems  to  be  tested  are  often 
embedded . 

4.. 6. 7. 2.1  Cooperative  Instrumentation 

Indeed,  even  with  the  bast  of  ground-based  instru- 
mentation, test  ranges  usually  demand  or  expect  some 
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kind  of  electronic  "cooperation”  from  aircraft  (or 
missiles)  under  test.  This  cooperation  often  takes  the 
form  of  a transponder  which  assists  the  ground  equip- 
ment in  measuring  ranges  or  angles,  and  may  also  serve 
as  a data-link  (one-way  or  both  directions)  between  the 
air  vehicle  and  the  ground.  The  reasons  are  largely 
economic:  the  use  of  a cooperative  transponder  affords 

options  for  TSPI  systems  which  would  otherwise  be  im- 
possible, or  at  least  much  more  expensive.  Transponders 
are  used  with  tracking  radars  even  when  they  are 
(theoretically)  unnecessary,  to  "clean  up"  the  tracking 
by  mitigating  or  removing  such  problems  as  glint, 
scintillation,  multipath,  and  ground  clutter.  For 
surveillance,  IFF/ATCRBS  may  be  employed  to  "enhance" 
search  radar,  and  to  serve  as  a (limited  capacity)  data 
link  from  air  to  ground. 

In  addition  to  the  need  for  electronic  cooperation 
for  trajectory  measurement,  there  are  some  categories 
of  information  which  are  simply  more  easily  obtained 
from  instrumentation  carried  by  the  aircraft  than  by 
instruments  on  the  ground.  Attitudes  and  rates  of 
change  of  attitude,  for  example,  are  more  easily  meas- 
ured by  inertial  sensing  elements  carried  by  the  air 
vehicle.  Also,  the  direct  measurement  of  acceleration  by 
airborne  accelerometers  has  a better  chance  of  being 
accurate  (and  up-to-date)  than  an  inferred  value  ob- 
tained by  doubly-differentiating  (perhaps  implicitly,  in 
some  form  of  filter)  position  measurements  made  on  the 
ground,  and  can  contribute  to  the  job  of  defining  the 
high-frequency  components  of  trajectory. 

Because  these  devices  which  "cooperate"  with  test 
ranges  and  are  not  normally  a part  of  the  avionics  com- 
plement of  operational  aircraft,  some  means  must  be 
found  to  attach  them  to  the  airplanes  during  testing  or 
training.  The  most  common  method  is  to  attach  them  the 
way  weapons  are  attached — i.e.,  in  the  fom  of  some  type 
of  externally-carried  pod. 

In  some  classes  of  testing — particularly  R&D 
tests — the  necessary  cooperative  instruments  may  be 
carried  internally,  and  special  antennas  or  other 
structures  mounted  on  the  fuselage  or  elsewhere  on  the 
aircraft  skin.  However,  for  operational  tests  and 
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training  situations,  this  option  rarely,  if  ever, 
-exists,  because  of  the  "no-mod"  rule.  This  "rule," 
which  is  nearly  a universally-observed  \inwritten  law, 
simply  says  that  there  will  be  ^ modification  of 
operational  aircraft.  Of  course,  these  are  exactly 
: the  aircraft  which  are  involved  in  operational  testing 

• and  training.  This  "no-mod"  rule  is  quite  understand- 
able from  the  viewpoint  of  a commander  of  an  operational 

■ squadron.  Since  his  primary  responsibility  is  to  be 
prepared  to  go  to  war  at  a moment's  notice,  he  is 
naturally  quite  reluctant  to  permit  any  surgery  in  the 
electronic  guts  of  his  airplanes,  no  matter  how  well- 

• intsntioned.  So,  test  instrumentation  and  "cooperating" 
electronics  are  packaged  in  pods  and  carried  on  weapon 
stations. 

4. 6. 7. 2. 2 Limitations  of  Instrumentation  Pods 

As  a result,  there  has  been  a proliferation  of  pods 
of  different  sizes,  shapes,  contents,  and  functions. 
Elsewhere  in  this  document,  the  attempts  by  TESPO  to 
consolidate  test  instrumentation  pods  into  a Standard 
Airborne  Instrumentation  System  (SAIS)  pod  with  modular, 
interchangeable  functional  sections  is  described.  But 
SAIS  is  at  best  only  a partial,  interim  solution.  There 
are  several  reasons. 

First,  SAIS  cannot  be  very  cheap.  If  the  SAIS 
concept  results  in  saving  money,  it  will  be  because  the 
logistic  support  for  instrumentation  pods  can  be  reduced 
and  consolidated,  and  because  large  quantity  procure- 
ments can  help  keep  unit  costs  down.  But  each  SAIS  pod 
will  necessarily  still  be  quite  expensive.  For  example, 
the  SAIS  is  expected  to  perform,  in  one  of  its  configura 
tions,  the  functions  of  the  Airborne  Instrumentation 
System  (AIS)  pod  associated  with  the  Air  Combat  Maneuver 
ing  Instrumentation  CACMI)  System,  described  elsewhere 
in  this  document.  AIS  pods  currently  cost  more  than 
$100,000  each. 

This  introduces  a second  point,  which  the  AIS  pod 
illustrates  well.  The  "no  mod"  rule  often  forces  pod 
designers  to  duplicate,  in  the  pod,  measurements  which 
are  already  being  made  more  accurately  by  expensive 
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avionics  systems  located  only  a few  feet  away — inside 
the  aircraft.  The  AIS  pod  contains  a pitot-static 
system  and  pressure  transducers,  inertial  elements 
to  measure  accelerations  and  attitude  rates,  and  a 
computer  to  integrate  these  to  produce  estimates  of 
attitude  and  velocity,  duplicating  the  functions  of 
the  aircraft's  own  central  air  data  computer  and 
navigation  system.  Some  may  feel  that  such  duplica- 
tion is  desirable  or  even  necessary,  and  argue  that  it 
is  dishonest,  if  not  incestuous,  to  accept  the  avionics 
system  outputs  of  the  aircraft  under  test  without  an 
independent  check.  As  a practical  matter,  however,  the 
pod-mounted  independent  inertial  instruments  indicated 
above  cannot  attain  the  accuracy  required  to  "check"  or 
compete  with  an  internally-mounted  INS,  because  they 
must  operate  within  the  limited  space,  weight,  power 
and  a mechanical  environment  of  vibration  and  buffeting, 
which  is  characteristic  of  pods.  Similarly,  the  pitot 
static  system  in  the  pod  cannot  hope  to  be  as  well- 
calibrated  for  the  peculiarities  of  airflows  (at  all 
of  the  various  stations  of  the  many  aircraft  types  which 
may  carry  it)  as  the  air-data  system  built  into  the 
airframe.  Thus,  the  "independent  check"  is  largely 
imaginary  — and  usually  unnecessary,  since  R&D  tests 
will  have  already  established  the  technical  character- 
istics of  aircraft  avionics,  and  these  are  rarely  at 
issue  during  operational  testing  or  training. 

But  pods  are  unsatisfactory  for  a more  basic 
reason:  no  access  to  internally-generated  signals  which 

convey  the  interactions  between  man  and  machine. 

Because  OT&E  and  training  are  principally  concerned  with 
this  interface  (Is  the  machine  suitable  for  use  by 
operational  forces?  How  can  people  be  trained  to  get 
the  most  out  of  this  machine?)  it  is  not  surprising  that 
such  events  as  crew  switch  actions  to  select  and  prepare 
weapons,  radar  lock-on,  break- lock,  key  weapon  and 
avionics  system  status  and  readiness  indicators,  RHAW 
outputs,  selection  of  ECM  choices,  etc.,  are  typical  of 
the  action- reaction  data  often  needed  (and  seldom 
satisfactorily  collected)  during  OT&E.  These  informa- 
tion-rich data  elements  can  only  be  obtained  from  inside 
the  aircraft. 
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4. 6. 7. 2. 3 Another  Alternative 


It  is  therefore  reasonable  to  expect  that  a fruit- 
ful opportunity  exists  to  improve  Air  Force  OT&E  and 
training  capability  by  incorporating,  in  production- 
model  aircraft  intended  for  operational  forces,  specific 
technical  provisions  to  facilitate  the  extraction  of 
data  from  aircraft  avionics,  fire-control,  and  electronic 
warfare  systems  for  operational  test  and  training 
purposes,  while  still  adhering  to  the  "no-mod"  rule. 
Specifically,  the  basic  idea  is  to  incorporate,  as 
"standard"  in  every  operational  aircraft  of  a given 
type,  wiring  and  any  necessary  signal-conditioning 
equipment  which  would  permit  the  addition  of  recording 
and/or  telemetry  equipment  in  a simple  way  (e.g., 

"plugged  in"  at  a "common  data  point")  when  needed  for  a 
particular  operational  test  or  training  mission.  The 
advent  of  micro  miniature  data-handling/computing 
hardware,  and  particularly,  the  multiplexed,  digital 
data-bus  concept  for  aircraft  avionics  and  weapons 
control  systems  adds  credibility  to  the  supposition  .that 
the  cost  and  penalty  of  weight,  volvime,  and  power 
consumption  of  such  wiring  and  necessary  electronics 
associated  with  such  a data-extraction  "plug"  could  be 
made  a negligibly  small  percentage  of  the  cost,  weight, 
volume  and  power  of  the  aircraft's  avionics  system. 

Significantly,  the  necessary  engineering  to  deter- 
mine methods  by  which  such  signals  can  be  formatted .and 
extracted  is  alreay  accomplished  to  a large  degree  in 
the  outfitting  of  prototype  aircraft  Development  Test 
and  Evaluation.  Wliile  it  is  not  suggested  that  DT&E 
instrumentation  be  retained  in  production  aircraft,  the 
design  of  a "common  data  point"  with  reduced,  yet 
flexible  capability  suitable  for  support  of  OT&E  and 
training  can  obviously  benefit  from  the  prior  engineer- 
ing and  development  of  DT&E  instrumentation  and  data- 
collection  systems.  An  example  of  this  is  the  McDonnell 
Mini-Integrated  Data  System  (MIDS)  (Reference  a)  which 
is  essentially  a reduced,  or  "austere"  adaption  of 
techniques  used  for  the  F-15  DT&E  flight  test  data 
collection. 


A typical  "shopping  list"  of  data  elements  of 
interest  in  many  OTT&E  or  training  situations  is  pre- 
sented in  Table  4.5.  Availability  and  accuracy  of  these 
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Table  4.5 

Typical  Common  Data-Point  Signals -Tactical  Aircraft 


Data  Item 

Time 

Heading 

Pitch 

Roll 

X Velocity 
Y Velocity 
Z Velocity 

Normal  Acceleration 
Longitudinal  Acceleration 
Lateral  Acceleration 
Attack  Angle 
Side-Slip  Angle 
FCR  Operating  Mode 
FCR  Antenna  Bearing 
FCR  Antenna  Elevation 
FCR  Range 
Pressure  Altitude 
True  Airspeed 
Outside  Air  Temperature 
Clearance  Altitude 
IFF/SIF  Reply  Code 
Roll  Rate 
Pitch  Rate 
Yaw  Rate 


Internal  Clock 
Nav.  of  AHRS 
Nav.  of  AHRS 
Nav.  of  AHRS 


Nav  System 
Nav  System 
Nav  System 
Added  pkg.  or  Hav 
Added  pkg.  or  Nav 
Added  pkg.  or  Nav 
Aircraft  AA  Sensor 
Aircraft  Sensor 
Fire-Control  Radar 
Fire-Control  Radar 
Fire-Control  Radar 
Fire-Control  Radar 
Air  Data  System 
Air  Data  System 
Air  Data  System 
Radar  Altimeter 


IFF  System 
Nav.  or  added  Sensor 
Nav.  or  added  Sensor 
Nav.  or  added  Sensor 


Latitude  (Coarse  & Fine) 
Longitude  (Coarse  & Fine) 


Nav,  System 
Nav.  System 
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Table  4.5  (Continuted) 


Data  Item 


Weapons'Release  Modes: 

\ 

Toss 

Stik/Toss 
Loft 

OTS/Toss 
Ballistic 
Direct 
Ripple 

Weapons  Feedback  and  Interface 
Signals.' 

Ready  to  Fire 
Lock-on 
In-Range 
In-Envelope 
Seeker  Look  angles 
English  Bias 
VT  AS /SEAM 
Pylon  Release  Signals 
Stations  Occupied 
Gun  Rounds  Remaining 
Bomb  Button  \ 

Gun  Trigger  ( 

Master  Arm  | 

Navigation  System  Update  / 
Gun  Camera  On  (If  Installed) 
Strike  Camera  On  (If  Carried) 
Fuel  Remaining 


Afterburner  Status 
Speed -brake  Deployment 


Source 


Cockpit  Switch  Settings 


Missile  Umbilical 
Missile  Umbilical 
Weapon-Control  Computer 
Weapon-Control  Computer 
Missile  Umbilical 
Weapon -Control  Computer 
Weapon-Control  Computer 
Aircraft  Weapon  Stations 
Aircraft  Weapon  Stations 
Weapon-Control  Computer 


Cockpit  Switches 


Gun  Camera  Control 
Strike  Cam.era  Control 
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Table  4.  5 (Continued) 


RHAW  Signals: 

Mode  I 

Threat  Indications  ) 

ECM  Switchology: 

Mode  Selection  I 

On /Off  } 

Chaff  Release  ) 

TISEO  System  Controls 
Laser  Designator  Controls 
Laser  Range 
BIT  Failure  Indications 


RHAW  system 

EW  Control  System 
(if  carried) 

(if  a laser  system  is  aboard) 
Built-in  test  equipment 
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measurements  will  vary  in  accordance  with  the  type  and 
mission  of  the  aircraft,  and  with  its  particular  mix  of 
on-board  systems.  For  this  reason,  and  to  provide 
adaptability  to  meet  unforeseen  needs  of  future  tests, 
some  flexibility,  or  programmability  of  selection  from 
such  a shopping  list  must  be  a basic  characteristic  of 
the  technical  implementation.  While  "standard"  tele- 
metry or  recording  formats  are  a reasonable  goal,  it 
will  probably  be  necessary  to  compromise  on  the  degree 
of  standardization  of  data  frame  structures  and  content. 
Standardization  of  physical  electrical  connectors  is 
very  desireible,  but  not  mandatory. 

This  is  not  a new  idea.  Air  Defense  Command's 
4756th  Test  Squadron  at  Tyndall  AFB  routinely  modifies 
F-106's  to  add  "common  data  point"  wiring  and  signal- 
conditioning  electronics  to  extract  information  in  sup- 
port of  its  mission  to  conduct  OT&E  for  ADC.  A November 
1969  IEEE  article  (Reference  b)  co-authored  by  Colonel 
C.  R.  Phillips  (USAF,  Ret)  stressed  the  need  to  plan, 
from  the  start,  to  obtain  the  data  necessary  for  "combat 
effectiveness"  evaluations,  in  Service  Tests,  OT&E,  and 
even  on  into  combat,  with  the  necessary  equipment  to 
obtain  this  information  carried  as  an  essential  com- 
ponent of  the  system  itself.  A 1966  WSEG  Report  (Reference 
c)  noted  the  pavicity  of  useful  information  being  obtained 
from  Southeast  Asia  air  operations,  identified  the  types 
of  information  needed,  and  suggested  instrumentation 
techniques.  This  report  prompted  Dr.  Foster  (DDR&E)  to 
encourage  Joint  Task  Force  Two  to  develop  and  demonstrate 
the  feasibility  of  a small,  built-in  airborne  data- 
collection  system  (Reference  d)  along  the  lines  sug- 
gested by  WSEG.  These  examples  convey  a common  message: 
Exploit  the  onboard  instruments  and  data  sources  avail- 
able in  operational  aircraft. 

Though  the  idea  is  not  new,  these  are  some  important 
recent  technological  advances  which  make  its  imple- 
, -mentation  much  simpler  and  more  economical  than  ever 
before.  The  most  significant  of  these  is  the  "digital 
airplane"  concept  of  avionics  systems  - or  more  officially, 
Digital  Aircraft  Information  System  (DAIS)  (Reference  e) . 
This  concept  being  implemented  in  the  B-1,  F-15,  and 
F-16  involves  the  intercommunication  and  time-sharing  of 
a central  computer  among  a number  of  sensors,  avionics. 
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and  weapons  control  systems  via  a digital  "party  line," 
i.e.,  a multiplexed  data-bus  which  serves  as  the  com- 
munication medium  among  the  several  aircraft  systems. 

Its  importance  to  the  provision  of  a "common  data  point" 
for  access  to  aircraft  data  sources  lies  in  the  fact 
that  this  party  line  provides  such  access  already, 
without  installing  additional  wiring  and  signal-condi- 
tioning equipment  in  the  aircraft.  This  means  that  the 
required  capability  can  be  furnished  by  making  provision 
in  the  aircraft  for  adding  a device  to  "tap"  this  party 
line,  with  a programmable  capability  to  pick-off  data 
items  of  interest  as  they  appear  on  the  line  and  re- 
format them  for  transmission  to  the  ground  via  con- 
ventional telemetry  or  air-to-ground  data  link.  Thus 
the  additional  weight,  space,  and  power  requirement 
imposed  on  operational  aircraft  can  be  made  very  small, 
and  truly  insignificant,  if  the  capability  is  planned  as 
a part  of  the  DAIS  design. 

4 . 6 . 7 . 2 . 4 Current  Status 


In  March  1975  TESPO  initiated  an  investigation  of 
the  possibilities  for  such  exploitation  in  the  current 
and  coming  generation  of  tactical  operational  aircraft, 
at  a very  low  level  effort  (two  man-months)  in  parallel 
with  its  contractual  study  of  the  SAIS  pod.  This  two- 
man-month  effort  included  visits  and  discussions  with 
representative  of  ADTC,  4756th  Test  Wing  (Tyndall  AFB) , 
ADC  (SPOs  for  F-15,  F-16,  F-5,  EF-111  and  A-lO  plus 
the  Engineering  Directorate) , Air  Force  Avionics 
Laboratory,  F-15  Joint  Test  Force  at  Edwards  AFB, 
Northrop,  and  McDonnell-Douglas.  Without  exception,  the 
individuals  contacted  offered  encouragement  that  the  con- 
cept is  a "good  idea,"  "long  overdue,"  etc.,  though  air- 
craft SPOs  predictably  voiced  some  reservations  on  the 
possibility  of  getting  it  into  their  aircraft. 

In  the  process  of  this  investigation  several  other 
potentially  important  uses  for  the  same  data-extraction 
capability  emerged,  aside  from  the  principal  motivation 
to  enhance  OT&E  and  training.  These  are  discussed 
briefly  below; 
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a.  Diagnostic  Tool  for  Maintenance . If  the 
"data-pickof f box*'  and  a recorder  were  carried  rou- 
tinely, such  a facility  could  be  extremely  valuable  for 
corrective  or  preventive  maintenance,  particularly  in 
resolving  the  frustrating  crew  reports  of  system  fail- 
ures which  seem  to  "heal  themselves"  the  moment  the 
aircraft  lands.  In  this  role,  the  "common  data  point" 
would  be  an  extension  of  the  Built-In  Test  (BIT)  con- 
cept, for  which  precedent  is  already  well-established. 

b.  Fatigue-Life  Accounting.  Additional  equip- 
ment and  wiring  to  measure  and  record  the  occurrence  of 
high-g-loading  have  been  installed  in  combat  aircraft 
for  this  purpose  alone.  The  common  data  point,  with  a 
suitetble  recorder,  could  obviously  serve  this  purpose. 

c.  A Tool  for  Analysis  of  Combat.  The  pos- 
sibility to  monitor  ancl  record  our  own  avionics  systems, 
particularly  the  radar  and  RKAW,  affords  an  opportunity 
to  analyze  the  enemy's  counters  to  our  tactics  and  equip- 
ment, and  to  pinpoint  problems  in  our  own  equipment 

or  facilities. 


4. 6. 7. 2. 5 Conclusions  and  Recommendations 

Within  the  limited  effort  thus  far  devoted,  it  has 
not  been  possible  to  determine  the  impact  on  cost  or 
schedule  to  implement  a common  data  point  capability 
into  any  given  aircraft.  However,  some  tentative  con- 
clusions and  recommendations  can  be  stated: 

a.  For  the  F-15,  the  multiplexed  data-bus  permits 
a very  simple  and  straightforward  implementation.  In 
fact,  the  McDonnell-developed  MIDS  provides  essentially 
;the  capability  described  above.  However,  MIDS  is  not 
an  Air  Force  requirement,  and  no  plans  exist  for  quantity 
•procurement.  Similarly,  the  DAIS  concept  of  avionics 
in  the  P-16  should  facilitate  provision  of  the  capability 
;in  that  aircraft,  if  a requirement  were  stated  for  it. 

The  F-5E  has  more  conventional  avionics,  but  a modifica- 
tion to  provide  a common  data  point  is  certainly  feasible. 
Especially  for  those  F-5Es  to  be  assigned  as  an  "aggres- 
sor squadron"  such  a modification  seems  well  worthwhile, 
since  such  an  aircraft  will  be  in  constant  use  in  train- 
ing and  test  situations. 
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The  austere  avionics  complement  of  the  A-10,  and 
the  limited  wiring  access  through  the  titanium  cockpit 
shield  makes  an  installation  less  attractive,  and  more 
difficult.  Insufficient  information  was  obtained  on 
the  EF-111  to  permit  a judgment,  though  SPO  members 
contacted  were  interested  in  the  potential  of  the 
idea  for  maintenance  assistance  of  the  complex  electronics 
for  that  aircraft. 

Actions  recommended,  to  continue  or  follow-up  the 
investigation,  are  along  three  concurrent,  mutually 
supporting  lines: 

- Initiate  funded  contractual  studies  to  determine 
technical  methods,  cost  and  schedule  to  incorporate  a 
common  data  point  in  the  F-15,  F-16  and  F-5. 

- Solicit  comments,  suggestions,  and  requirements 
from  using  commands,  particularly  TAG,  ADC,  and  ATC. 

- Identify  sources  of  funding  from  allocations  to 
"OTT&E  Improvement"  which  may  be  used  for  common  data 
point  development,  and  provide  assistance  to  Air  Staff 
in  modifying  the  ROCs  for  one  or  all  three  of  these  air- 
craft and  generating  an  appropriate  PMD  (or  addition  to 
a current  PMD)  to  undertake  the  effort. 

4. 6. 7. 2. 6 References 

a.  F-15  Integrated  Data  System,  McDonnell  Air- 
craft Company  Report  H^'77-1,  30  Sep  71,  Revised  12  Jul 
74. 

b.  Walker,  N.  K. , and  Phillips,  C.  R. , "The  Need 
for  Allocating  Resources  to  Combat  Effectiveness  Measure- 
ments from  Initial  R&D  to  Obsolescence,"  IEEE  Transactions 
on  Engineering  Management,  Vol  16,  No.  4,  Nov  '6i9. 

c.  Requirements  for  Data  from  Combat  Operations 
in  Southeast  Asia,  Weapon  Systems  Evaluation  Group 
Report  No.  101,  Aug  66  (SECRET) . 

d.  Combat  Aircraft  Recording  and  Data  System 
(CARDS)  Description  and  Flight  Test  Report,  Joint  Chiefs 
of  Staff  Report  JTF-2CARDS,  Nov 
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e.  Aircraft  Internal  Time  Division  Multiplex 
Data  Bus,  Military  Standard  MIL-STD-1553  (usAF) ,30 
Aug  V 3 . 

4.6.8  Special  Considerations  for  Calibration  and 
Related  Matters 


In  the  application  of  instrumentation  in  general  and 
TSPI  systems  in  particular  the  results  obtained  are  re- 
liable only  to  the  extent  that  the  orientation  and  time 
calibration  are  reliable.  This  reliability  must  be  con- 
sidered with  respect  to  an  acceptable  standard  for  the 
mission,  and  it  should  be  understood  that  the  standards 
may  vary  according  to  the  requirements  of  the  mission. 

■"t 

The  two  subsections  which  follow  discuss  at  some  i 
length  the  matters  of  orientation  and  time  standard- 
ization. 

4. 6. 8.1  Calibration 


4. 6. 8. 1,1  Introduction 

This  section  discusses  techniques  and  their  limita- 
tions for  calibration  of  range  instrumentation,  such  as 
radars,  theodolite  arrays  and  multilateration  systems. 
Calibration  is  performed  to  ensure  that  measurements  made 
with  an  instrument  will  be  defined  relative  to  the  true 
value  of  the  quantity  measured  within  a defined  error 
tolerance  or  specified  accuracy.  No  attempt  is  made  to 
describe  how  calibration  should  be  done,  emphasis  instead 
is  on  what  is  necessary  to  ensure  or  improve  tracking 
system  accuracy.  Accuracy  of  a measurem.ent  (or  the  mean 
of  a number  of  similar  measurements)  refers  to  the  extent 
which  a measurement  conforms  to  the  true  or  absolute 
value.  It  applies  to  timing,  random  (nondeterministic  or 
noise-like)  and  systematic  (deterministic)  components  of 
error  (see  Section  4. 6. 8. 1.2  for  discussion  of  errors). 
Systematic  errors  include  angle  and  position  alignment 
ment  errors  as  well  as  equipment,  environmental  and  tar- 
get motion  induced  anomalies.  Their  characteristics  are 
such  that  they  may  be  deterministically  modeled.  A given 
reading  also  may  be  characterized  by  its  precision  — the 
quality  of  being  exactly  or  sharply  defined  and  free  from 
random  errors.  Thus,  an  accuracy  specification  must 
govern  all  errors  in  the  system,  and  must  allow  a greater 
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tolerance  than  the  precision  specification  which  covers 
only  random  errors.  Instrumentation  manufacturers  pro- 
vide a precision  specification  and  often  accuracy  rela- 
tive to  the  base  alignment  of  the  instrument.  The 
accuracy  achievable  in  the  field  will  depend  on  how  it  is 
operated,  maintained  and  calibrated. 

Resolution  is  also  used  in  connection  with  accuracy 
and  precision.  In  the  usual  connotation,  resolution  is 
the  ability  of  the  sensor  to  separate  closely  spaced  tar- 
gets. For  a tracking  system,  one  can  speak  of  both  range 
resolution  and  angle  resolution. 

The  data  produced  by  an  instrument  are  subject  to 
timing,  random,  and  systematic  errors.  Calibration  is 
the  process  whereby  systematic  instrument  errors  are 
discovered/observed,  sorted  out  or  correlated  with  the 
source  of  error  and  either  removed  or  modeled;  i.e., 
error  models  for  each  error  source  produced.  The  error 
models  are  then  used  to  remove  the  errors  from  the  data 
produced  (post  flight  data  processing)  or,  alternatively, 
may  be  used  to  provide  additions  to  the  instrument 
tracking  system  in  such  a way  as  to  prevent  errors  from 
occurring  (in-loop  processing).  In  either  case,  a com- 
puter of  other  mechanization  is  needed  for  the  error 
removal  process.  The  use  of  a computer  in  the  calibra- 
tion process  to  control  the  observational  procedure  and 
automate  the  error  modeling  process  is  advantageous  for 
repeatability  and  time  saving. 

Observability;  i.e.,  the  ability  to  note  errors,  is 
important  in  each  step  of  the  calibration  process. 
However,  it  is  most  important  in  the  error  removal 
process,  where  it  is  most  often  lacking.  Only  by  ob- 
serving the  end  effect  of  the  calibration  process  can  one 
have  confidence  in  the  accuracy  of  the  system.  In  fact, 
if  errors  are  observed  after  error  removal,  then  itera- 
tion back  through  the  calibration  process  to  refine  error 
models  and/or  control  the  removal  process  is  necessary 
until  the  required  system  accuracy  (or  all  the  system  is 
capable  of)  is  achieved.  A separate,  acceptable  standard 
to  compare  against  is  necessary  for  the  final  evaluation 
of  system  accuracy. 
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Each  tracking  system  will  have  its  own  unique  re- 
strictions on  the  calibration  techniques/processes  avail- 
able and/or  implementable.  One  is  forced  to  make  do  with 
what  can  be  made  available.  Within  these  constraints, 
the  best  accuracy  results  can  only  be  achieved  through 
meticulous  attention  to  detail  throughout  the  calibration 
process.  Calibration  checks  should  be  performed  often 
enough  to  ensure  the  accuracy  of  the  tracking  data;  e.g., 
before,  during  (if  possible)  and  after  a measurement 
mission. 


4. 6. 8. 1.2  Error  Sources  (Figure  4-28) 

The  factors  contributing  to  the  accuracy  of  tracking 
systems  are  multiple  in  number  and  complex  in  nature. 

The  various  errors  which  must  be  determined  affect  the 
system  accuracy  to  different  degrees  and  in  some  cases 
also  interact  with  other  errors.  Basically,  the  total 
error  in  a given  measurement  may  be  defined  as  the  dif- 
ference between  the  measured  value,  as  indicated  by  the 
sensor/ instrument , and  the  true  value.  ' It  is  necessary 
that  all  of  the  dete3rministic  errors  inherent  in  the 
instrument  be  ascertained  in  order  that  a reasonable 
error  budget  can  be  established  and  significant  errors 
models  and  compensated  for  if  necessary  to  achieve  the 
required  accuracy. 

It  is  common  practice  to  divide  errors  into  two 
categories:  random  (nondeterministic)  and  systematic 

(or  detenriinistic)  errors.  Time,  which  is  treated  as  an 
independent  variable  in  processing  data,,  also  can  be  a 
serious  source  of  error.  Care  must  be  taken  to  ensure 
time  accuracy  and  that  position  and  position  derivatives 
are  correctly  time  associated.  The  random  errors  are 
not  correctable  via  calibration,  but  their  effects  can 
be  reduced  by  smoothing.  The  smoothing  of  the  random 
errors  is  performed  to  determine  the  mean  over  the  data 
span.  The  mean  value,  if  different  from  zero,  is  used 
as  a bias  in  the  error  model.  The  systematic  errors  are 
characterized  by  being  deterministic  (predictable)  and 
ere  amenable  to  correction  by  a process  of  calibration 
applied  to  the  instrument  before  measurements  are  made. 
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The  total  instrument  error  is  a combination  of  a 
large  number  of  individual  errors.  Table  4.6  sxammarizes 
the  significant  error  sources,  together  with  remarks 
on  each.  Not  all  of  the  potential  errors  identified 
will  be  pertinent  to  a well-designed  tracking  radar, 
nor  to  electronic  tracking  systems,  such  as  multilatera- 
tion  system. 


Observing  sensor/instrument  errors  requires  a 
separate  calibration  or  evaluation,  reference  sensor 
(or  sensors) . An  additional  source  of  error  is  intro- 
duced by  the  reference  sensor (s)  against  which  the 
sensor/instrument  is  being  compared.  The  errors  from 
this  source  (as  applicable  in  Table  4.6)  must  be  isolated 
from  the  errors  of  the  instrument  being  calibrated;  i.e., 
the  pertinent  reference  sensor (s)  errors  must  be  ade- 
iquately  modeled  and  removed  or  compensated  for  prior  to 
use  in  calibration. 

4. 6. 8. 1.3  Calibration  Techniques/Procedures 

The  purpose  of  calibration  of  instruments  is  to  as- 
sure that  measurements  made  with  each  instrument  will 
represent  the  true  value  of  the  quantity  measured  within 
a defined  error  tolerance  or  specified  accuracy.  The 
calibration  can  be  done  in  several  different  ways,  but 
the  accuracy  of  the  calibration  will  differ  as  a function 
of  the  method  chosen.  The  choice  of  calibration  tech- 
nique in  each  instance  will  be  made  on  the  basis  of 
availability,  adapatability,  accuracy,  and  cost. 

An  interesting  example  is  in  the  Federal  Aviation 
Regulation  (FAR  91.25)  requiring  periodic  calibration 
checks  of  the  airborne  very  high  frequency  oinni  range 
(VOR)  equipment  for  instrument  flight  rules  (IRF)  opera- 
tion. This  regulation  specifies  no  less  than  five  ac- 
ceptable VOR  calibration  check  methods,  with  two  dif- 
ferent measurement  tolerances  being  acceptable.  The 
technique  chosen  will  depend  primarily  on  availability 
and  the  resulting  accuracy  verification  will  vary  but 
will  be  withi.n  the  tolerance  specified.  Note  that  the 
prcccdureE  of  FAR  91.25  are  only  for  a calibration 
check  or  verification  of  accuracy.  If  the  instrument  is 
oixt  of  tolera.nce,  then  repair  and/or  recalibration  is 
indicated.  This  example  is  intended  to  illustrate  the 
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TABLE  4.6:  EXAMPLES  OF  ERROR  SOURCES 
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ABLE  4.6:  EXAMPLES  OF  ERROR  SOURCES  (CONT.) 
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need  to  approach  the  calibration  problem  in  a flexible 
and  imaginative  manner,  with  due  consideration  to  prac- 
ticality, the  accuracy  actually  required,  and  the  degree 
of  assurance  necessary. 

The  same  philosophy  applies  to  test  r£Uige  tracking 
instrumentation.  A variety  of  calibration  techniques/ 
procedures  are  possible  and  the  choice  depends  on  what  is 
"best"  for  a given  installation  and  accuracy  requirement. 

Calibration  in  the  context  used  here  involves  the 
observation  of  systematic  errors,  modeling  them  and  error 
removal  and/or  compensation.  Different  levels  of  calibra- 
tion are  currently  used,  partly  as  dictated  by  accuracy 
requirements  and  partly  due  to  limitations  inherent  with 
the  instrumentation. 

Many  radars,  for  example,  are  calibrated  only  with 
respect  to  a boresight  target  and  instrument  level.  This 
accommodates  zero  setting  of  the  angle  and  instrviment 
level.  This  accommodates  zero  setting  of  the  angle  and 
range  encoders  and  leveling  to  local  gravity.  An  inte- 
gral system  computer  is  not  availeible  and  most  of  the 
systematic  errors  are  not  observed  (detected)  or  cor- 
rected. 

Trajectory  instrumentation  is  used  to  track  air- 
craft, missiles,  and  other  objects  for  performance 
evaluation.  The  product  is  a single  vector  composed  of 
position,  velocity  and  acceleration,  all  at  the  same  time 
(TPVA) , which  adequately  describes  the  motion  of  a 
target.  If  the  target  is  maneuvering  a series  of  vectors 
(TPVA)  which  approach  instantaneous  rather  than  average 
values  are  required.  The  accuracy  of  the  trajectory 
observation  is  determined  by  the  accuracy  of  the  time 
position  derivative  of  significemce, 

4. 6. 8. 1.3.1  Error  Removal 

A tracking  instrument  with  a computer  (the  com- 
puter in  some  cases  may  not  be  colocated)  can  accomplish 
a higher  level  of  calibration.  The  compensation  for  more 
of  the  errors  influencing  tracking  accuracy.  Note  that 
the  "computer"  need  not  be  a digital  machine  to  quality— 
analog  devices  for  error  compensation  also  are  used. 
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' The  computer  may  be  used  with  the  instrument  either 
for. post  flight  or  in-loop  data  processing  for  error  cor- 
rection. In  a calibration  sense,  it  provides  the  means 
of  accommodating  a variety  of  systematic  error  models 
(droop,  non-orthogonality,  refraction,  etc.)  and  modify- 
ing the  tracking  system  and/or  data  accordingly  to  remove 
the  effect  of  the  errors.  Note  that  when  used  post 
flight,  the  data  processing  is  dependent  on  a priori 
knov;ledge  of  the  error  models;  i.e.,  there  is  low  observ- 
ability (detectability)  of  the  correctness  of  the  error 
modeling  and  removal  process.  Inadequate  error  cor- 
rection and/or  incorrect  use  of  one  or  more  individual 
error  models  could  occur  and  not  be  noted.  In  the 
absence  of  observcibility , there  can  be  no  assurance  that 
the  desired  accuracy  improvement  is  achieved.  Making  the 
judgment  that  the  trajectories  obtained  appear  "reason- 
ablfe"  does  not  s’lbstitute  for  observability.  On-line 
data  processing  for  error  removal;  i.e.,  use  of  error 
calibration  models,  may  be  implemented  either  within  the 
radar  tracking  control  system  (in-loop)  or  outside  of  the 
tracking  loop  to  correct  the  measured  data  for  subsequent 
use.  Even  though  on-line,  the  latter  technique  is 
basically  post-flight  data  processing.  However,  it  does 
offer  potential  for  on-line  comparison  of  data  with  a 
reference  tracker  to  verify  correctness  of  error  removal. 
In-3oop  implementation  for  error  compensation  is  also 
possible.  Separation  of  error  sources  is  facilitated  by 
in-loop  processing,  as  is  error  modeling  and  observation 
of  correctness  of  error  removal. 

All  significant  systematic  error  sources  (equipment, 
dynamic  and  environmental  anomalies)  must  be  modeled  in 
the  calibration  process  to  allow  adjustment  to  correct 
for  the  errors.  Observability  is  necessary  at  each  step 
in  the  calibration  process,  including  verification  of 
the  correctness  of  error  removal.  Accuracy  of  the  error 
model  terms  determine  the  accuracy  of  the  tracking 
system,  assuming  no  timing  errors.  How  many  of  the 
potential  error  sources  must  be  modeled  and  to  what 
accuracy  depends  on  the  accuracy  requirements  placed  on 
the  instjrument.  In  general,  an  error  source  should  be 
modeled  and  corrected  for  if  its  potential  error  con- 
tribution is  as  much  as  one-tenth  of  the  allowable 
inaccuracy  (total  error)  for  the  instrument.  Calibra- 
tion chocks  must  be  performed  often  enough  to  ensure  the 
accuracy  of  the  system  and  to  allow  compensation  for 
errors  v?hich  may  vary  with  time. 
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4. 6. 8. 1.3. 2 


Error  Observation/Identificiation 


A number  of  techniques  are  used  for  observing  and/or 
modeling  systematic  errors  as  part  of  the  process  of  re- 
moving their  effects.  These  techniques  include: 

- Factory  calibration 

- Use  of  calibration  targets 

- One  or  more  towers 

- Use  of  the  stars 

- Dynamic  targets 

- Comparison  with  a "reference"  tracker 

- Multiple  radar  comparisons 

Factory  calibration  can  be  used  to  identify  and 
model  many  of  the  single  sensor  systematic  error  anom- 
alies? e.g.,  slew,  non-orthogonality,  droop,  encoder 
non-linearity,  etc.  Use  of  these  models  to  remove  errors 
requires  a computer.  Equipment  changes  which  affect  the 
errors  modeled  could  occur  in  moving  and  installing  the 
instrument  in  the  field.  The  error  terms  also  could 
change  with  time  due  to  aging  and  wear  of  the  instniment. 
In  memy  cases,  however,  these  factory  determined  error 
models  are  all  that  would  be  available  for  correction 
purposes.  Models  for  other  systematic  errors?  e.g., 
refraction,  transit  time,  apparent  acceleration,  etc., 
also  can  be  developed  by  the  manufacturer.  Their  use  in 
the  field  without  some  means  of  observing  their  validity 
is  suspect  for  all  of  the  factory  models  and  may  not 
yield  the  desired  accuracy  result. 

Use  of  calibration  targets  by  tracking  systems  is 
common.  Usually  this  consists  of  one  calibration  tower 
visible  to  the  tracker  at  a surveyed  location.  Use  of 
a single  calibration  target  only  allows  the  tracking  sys- 
tem to  achieve  good  static  accuracy  at  one  point.  How- 
ever, the  tracker  noirmally  must  be  capable  of  accurately 
tracking  dyneimic  targets  throughout  a hemisphere  and  ac- 
curacy will  degrade  as  it  is  pointed  away  from  the  cali- 
bration point.  The  achievable  accuracy  elsewhere  in  the 
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tracking  hemisphere  will  depend  on  the  leveling  accuracy, 
the  integrity  of  the  instrument,  and  the  validity  of  any 
error  modeling  incorporated.  Some  means  of  error  obser- 
vation is  necessary  to  ascertain  accuracy  throughout  the 
tracking  hemisphere.  For  many  tracking  radar  instal- 
lations, the  accuracy  requirements  and  instrument  pre- 
cision are  such  that  care  in  leveling  and  orientation 
with  a boresight  tower  is  all  that  is  required  to  achieve 
the  needed  accuracy.  The  ACMI  is  an  example  of  a multi- 
lateration  system  which  utilizes  a single  calibration 
target  for  calibration.  The  same  comments  apply  if  sur- 
veying accuracy  is  substituted  for  leveling  accuracy. 

In  some  cases,  more  than  one  calibration  tower  is 
used.  Beyond  forcing  the  static  accuracy  to  be  good  at 
two  or  more  points  near  zero  elevation  angle  instead  of 
one,  the  same  comraents  apply. 


A natural  extension  of  the  use  of  calibration  towers 
is  to  look  for  calibration  targets  scattered  throughout 
the  tracking  hemisphere.  The  stars  are  the  only  cali- 
bration targets  Creference  sources)  available  scattered 
throughout  the  tracking  hemisphere  and  suitable  for  track- 
ing system  to  autonomously  Cself)  calibrate  against.  Too 
few  radio  stars  (celestial  point  sources  of  radio  fre- 
quency energy)  are  available  for  this  purpose  and  only  a 
few  tracking  radars  are  capable  of  detecting  any  radio 
stars.  Thus,  use  of  the  stars  by  optical  means  are  dic- 
tated for  calibration.  For  a tracking  radar,  a boresight 
telescope  with  adequate  resolution  and  capable  of  detect- 
ing a sufficiently  large  number  of  stars  (even  in  day- 
light) is  required.  Given  an  appropriate  tracking  system 
and  computer,  the  use  of  stars  as  calibration  targets 
allows  definition  of  systematic  error  terms  (e.g.,  skew, 
non-orthogonality,  droop,  etc.),  determination  of  up 
(local  vertical)  and  North  to  an  accuracy  consistent  with 
the  resolution  of  the  boresight  telescope  (or  angle 
encoder  resolution  if  worse  than  that  of  the  telescope) . 
Properly  done,  this  can  give  the  optical  (boresight) 
system  an  absolute , static  accuracy  consistent  with  the 
system  res^ution.  The  systematic  errors  uniquely 
associated  with  the  microv7ave  (or  laser)  portion  of  the 
radar  system  must  then  be  modeled  and  the  radar  portion 
of  the  radar  system  brought  into  coincidence  with  the 
optical  system.  This  is  done  by  tracking  dynamic  targets 
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with  the  radar  which  are  also  visible  optically.  Dif- 
ferences in  atmospheric  refraction  at  optical  and  micro- 
wave  frequencies  must  be  taken  into  account  in  this 
process. 

The  star  calibration  technique  is  the  best  available 
for  autonomous,  essentially  static,  self-calibration.  It 
can  and  should  be  refined  to  verify  tracking  accuracy  on 
dynamic  targets.  This  can  be  done  by  using  a second 
such  tracking  system,  remotely  located  and  autonomously 
calibrated  against  the  stars.  Driving  the  remote  system 
with  tracking  data  from  the  first,  should  cause  the 
remote  system  to  point  to  the  target  to  within  the 
calibration  resolution.  Using  targets  on  near  overhead 
passes  of  the  remote  system,  small  errors  in  time  and/or 
relative  geodetic  location  between  the  two  systems  can  be 
observed  and  corrected. 

Use  of  the  stars  for  calibration  may  not  be  desir- 
able or  practical  for  all  systems.  Nevertheless,  some 
means  of  observing  tracking  errors  throughout  the  track- 
ing hemisphere  for  subsequent  removal  and/or  compensation 
is  required  if  there  are  accuracy  specifications  for  the 
tracking  data  to  be  obtained.  Comparison  of  the  tracking 
data  on  dynamic  calibration  targets;  e.g.,  calibration 
aircraft,  with  the  tracking  data  from  a reference  tracker 
can  provide  suitable  hemispherical  observability.  An 
additional  potential  error  source  is  introduced  by  the 
reference  tracker  against  which  the  sensor/instrument  is 
being  compared.  The  errors  from  this  source  must  be 
isolated  from  the  errors  of  the  instrument  being  cali- 
brated; i.e.,  the  reference  tracker  errors  must  be  ade- 
quately modeled  prior  to  its  use  in  calibration.  Ideally, 
the  reference  tracker  should  be  more  accurate  than  the 
instrument  being  calibrated  and  data  should  be  available 
for  comparison  on  line. 

Finally,  a technique  which  is  sometimes  used  to 
force  a consensus  among  a n\raiber  of  tracking  systems. 

The  consensus  will  define  a "reference  track"  which  in 
turn  can  be  used  to  model  the  errors  of  any  one  of  the 
tracking  systems  in  order  to  attain  better  agreement  of  . 
data.  This  achieves  better  agreement,  but  not  neces- 
sarily better  accuracy  for  a given  tracking  system.  All 
of  the  tracking  systems  will  have  errors,  and  the  resulting 
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consensus  will  also  contain  errors.  Post  flight  data 
processing  is  used  to  derive  the  consensus  track,  for 
error  model  adjustment  and  for  error  removal.  The  most 
accurate  system  will  be  degraded,  and  the  worst  system 
improved  if  the  systems  are  averaged.  In  a similar 
manner,  either  system  can  be  forced  to  agree  with  the 
other.  If  used  on  line  to  compare  systems,  this  techni- 
que may  have  some  validity  for  calibration  verification. 

The  techniques  described  above,  for  error  obser- 
vation or  identification,  basically  define  the  approaches 
available  for  calibrating  tracking  systems.  Being  able 
to  observe  errors,  and  the  degree  of  success  in  error 
removal,  is  critical  to  the  calibration  process.  It  is 
only  after  demonstrating  an  effective  means  of  containing 
the  significant  error  sources  that  one  can  speak  of  the 
accuracy  of  a tracking  system.  In  many  cases,  a lower 
precision  tracking  system,  but  calibrated  better,  also 
would  be  capable  of  satisfying  the  accuracy  requirements. 
In  .effect,  precision  in  excess  of  that  needed  is  being 
paid  for.  Optimum  use  of  available  calibration  proce- 
dures may  allow  requirements  to  be  met  with  a lov;er  pre- 
cision tracker  at  less  cost. 

, 4. 6. 8. 1.3. 3 Calibration  of  Distributed  Systems 

There  are  two  types  of  distributed  tracking  systems; 
angle  measuring  systems,  such  as  an  array  of  theodolites, 
and  multilateration  systems,  such  as  the  Air  Combat  Maneu- 
vering Range  (ACMR)  or  the  Range  Measurement  System 
(RMS-2/SC0RE) . Distributed  sensor  systems  consist  of  two 
or  more  measurement  sensors  located  some  disteince  from 
each  other.  Each  station  makes  a measurement  of  the 
target  angle  and/or  rahge  or  time  of  arrival  (TOA)  and 
then  a geometric  process  is  used  to  extract  target 
position  from  this  data. 

a.  Theodolite  fkrrays.  Two  stations,  measuring 
the  azj.muth  and  elevation  angle  of  a target,  are  suf- 
ficient to  establish  the  target  position.  Figure  4-29 
shov.rs  the  geometry  of  the  situation. 

Most  TSPI  accuracy  requirements  are  specified  in 
terms  of  ground-based  coordinate  systems  (typically  x = 
crossrenge,  y = downrange,  and  z = height) . The  equa- 
tions Vised  to  establish  the  position  (x,  y,  z)  of  the 
target,  are; 
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Uncertainty  is  associated  with  all  measurements. 

The  position  certainty  is  expressed  as  volume  of  un- 
certainty (VOU)  which  contains  the  target.  If  the 
measvirements  are  orthogonal  and  of  equal  precision,  the 
volume  is  described  as  a sphere.  If  the  measurements  are 
ponorthogonal , then  the  volume  is  larger  and  in  the  form 
of  an  ellipsoid.  Since  a distributed  sensor  system  is 
in  a practical  sense  nonorthogonal , the  VOU  of  a dis- 
tributed system  is  always  an  ellipsoid.  The  shape  and 
orientation  of  the  ellipsoid  changes  as  the  target  posi- 
tion varies  with  respect  to  the  sensors  in  the  network. 
The  VOU  is  that  voliome  in  which  the  target  is  always  con- 
tained, but  it  does  not  specify  the  target  location  as 
a point.  While  the  target  must  lie  within  this  VOU,  its 
probability  of  being  at  any  particular  point  in  the 
volume  Vcaries.  Hence,  a more  precise  error  definition 
would  be  an  ellipsoid  of  a constant  probability.  The 
probability  ellipsoids  change  in  shape  and  orientation  as 
position  changes.  Maximum  precision  is  achieved  when  the 
target  positioned  so  that  the  angular  measurements  from 
two  stations  are  at  right  angles  to  each  other. 
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An  optical  system  is  advantageous  for  use  as  a 
position  measurement  device  due  to  the  ability  to  "see" 
the  target  and  the  smaller  magnitude  of  systematic 
errors  (due  to  instrument  precision  cind  a much  smaller 
atmospheric  refractivity  at  optical  frequencies) . A 
theodolite  array  is  a post-flight  system  because  pro- 
cessing to  produce  position  is  done  after  data  collection. 
As  with  all  post-flight  systems,  there  is  no  observational 
check  on  results  except  possibly  a closure  reasonable- 
ness check, 

A cinetheodolite  is  an  optical  sensor  moianted  on  an 
elevation  over  azimuth  mount.  The  pointing  function  is 
most  often  accoitplished  manually.  Generally,  all  necessary 
data  are  contained  in  each  freime  of  a photograph,  fre- 
quently collected  by  a high-speed  camera.  Each  frame 
displays  time  (preferably  time  of  day) , azimuth,  elevation, 
the  boresight  center  defined  as  an  optically  visible  ret- 
icle, and  an  image  of  the  target.  Of  particular  interest 
is  the  method  of  collecting  and  displaying  the  instan- 
taneous azimuth  and  elevation  of  the  telescope.  Several 
techniques  are  used:  (1)  Both  azimuth  and  elevation  are 

obtained  using  a direct  reading  optical  train  which  dis- 
plays a graduated  scale  fixed  to  the  trunnion  of  each  axis 
on  the  film,  (2)  A digitized  value  of  azimuth  and  eleva- 
tion are  recorded  on  the  film  for  electronic  readout,  and 
(3)  The  angle  data  are  read  directly  into  a central  com- 
puter. The  azimuth  and  elevation  generally  are  not  used 
to  point  the  instrument,  thus  the  angle  reading  does  not 
introduce  velocity  and  acceleration  lags  which  would  accrue 
if  used  for  pointing.  Apparent  accelerations  are  seen 
in  the  azimuth  and  elevation  axes;  but,  since  there  are  no 
lags,  apparent  acceleration  is  automatically  removed  in 
the  transformation  to  a rectilinear  coordinate  system. 

The  Contraves  Electronic  Optical  Tracking  System 
(EOTS)  cinetheodolite  is  the  basic  unit  used.  It  is 
designed  to  produce  single  frame  images  on  35mm  film  at 
rates  from  5 to  30  frames  per  second.  Several  models  are 
available;  the  EOTSC,  EOTSD  and  EOTSF.  Both  the  EOTSC 
and  EOTSD  are  without  digital  readout  capability,  having 
projection  scales  upon  which  the  azimuth  and  elevation 
are  read  off  phtographically , Thus,  information  on  the 
single  tracked  target  is  not  available  on-line.  Cov- 
erage depends  upon  the  size  of  the  target  being  tracked 


139 


and  the  visibility  conditions  during  the  test.  Instrument 
precision  in  both  elevation  and  azimuth  is  1 arc  minute 
(.3  milliradian) . Data  reduction  to  determine  the  target 
cingles  is  done  manually  and  may  require  days  to  months 
depending  upon  the  workload  of  the  processing  facility. 

One  example  of  an  on-line  cinetheodolite  system  makes 
use  of  digitized  EOTSC  Contraves  cinetheodolite.  On-line 
azimuth  and  elevation  data  on  a single  target  are  fed 
digitally  to  a central  computer,  which  determines  the  x, 
y,  and  z coordinates  of  target  position.  Pointing  of  the 
cinetheodolites  is  done  manually;  the  operator  of  each 
unit  positions  the  cinetheodolite  using  a joystick  and  a 
sighting  scope,  aided  by  velocity  and  acceleration  track- 
ing information  from  the  computer.  When  the  unit  is  "oh 
track"  the  operator  signals  the  computer.  Data  rate  to 
the  computer  is  20  samples  per  second  with  display  data 
available  at  the  rate  of  5 sanples  per  second. 

Since  the  theodolite  system  measures  the  target  off- 
set from  a reticle,  the  significance  of  the  least  bits 
of  the  azimuth  encoder  changes  v/ith  respect  to  the  traverse 
resolution  of  the  sensor  as  a function  of  elevation  angle. 

A secant  correction  must  be  applied  to  the  left/right 
offset  as  a function  of  elevation  angle  in  transforming 
to  azimuth  angle. 

Although  volume  of  uncertainty  represents  a sta- 
tistical estimate  of  the  target  uncertainty,  it  does  not 
trcinslate  to  the  accuracy  of  the  total  system,  since  the 
system  contains  other  random  and  systematic  errors  in- 
fluences. The  systematic  error  model  generally  is  assumed 
small  and  ignored.  As  an  example,  the  results  of  refrac- 
tion cause  a sensor  to  point  higher  in  elevation  than  the 
true  angle  to  the  target.  Refraction  has  less  signifi- 
cance at  the  optical  region  of  the  spectrum  than  at  micro- 
wave  frequencies.  In  many  cases  of  theodolite  data  re- 
duction, refraction  corrections  are  not  made  in  the  fear 
that  refraction  is  not  well  enough  defined,  and  therefore, 
the  correction  may  make  the  data  worse  instead  of  improving 
it.  Theodolites  are  most  often  treated  as  the  standard. 
Verification  of  their  accuracy  is  rarely  attempted. 
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b.  Multllateration  Systems.  Basically,  the 
multilateration  trackers  are  electronic  ranging  systems 
which  compute  range  to  the  target  being  tracked  from 
three  or  more  presurveyed  locations  and  compute  the 
target  position.  Being  electronic,  the  system  has 
great  agility  and  can  "simultaneously”  track  a number  of 
targets.  It  also  can  easily  intersperse  "looks"  at  a 
calibration  target (s)  in  with  the  target  tracking  to 
verify  accuracy  (at  one  point)  and  system  integrity. 

The  self-calibration  thus  is  timely  but  limited  in 
scope.  Starting  with  two  or  three  pre-surveyed  sensor 
locations,  a system  may  use  its  electronic  reinging 
capability  to  self-survey  in  the  rest  of  the  sensor 
locations  required  (e.g.,  as  is  done  with  the  RMS-2/ 
SCORE).  (Note  that  accuracy,  including  that  of  self- 
surveying if  used,  must  be  verified  against  a suitable 
standard  to  validate  system  accuracy.)  Potentially,  the 
multilateration  system  should  be  capable  of  good  tracking 
accuracy,  at  least  in  the  horizontal  plane,  for  targets 
within  or  near  the  system.  Geometrical  dilution  of 
precision  (GDOP)  and  multipath  effects  will  seriously 
degrade  its  capability  to  measure  altitude  accurately  for 
relatively  low  altitude  targets.  Both  the  ACMI  and  the 
RMS/SCORE  attempt  to  solve  this  altitude  measurement 
problem  through  the  use  of  an  altitude  indication  tele- 
metered from  an  aircraft. 

Nothing  within  the  multilateration  system  is 
capable  of  confirming  measurement  accuracy  other  than 
at  the  static  calibration  target  point.  If  a known 
accuracy  is  required  of  the  system,  then  some  means 
of  observing  its  tracking  performance  at  representa- 
tive points  throughout  the  coverage  volume  is  required. 
This  can  take  the  form  of  accuracy  verification  tests  if 
it  is  deemed  probable  that  the  system  does  have  adequate 
accuracy  to  meet  mission  requirements.  However,  if  the 
verification  tests  identify  accuracy  deficiencies,^ 


^Note  that  the  initial  results  of  accuracy  verification 
tests  of  the  RMS-2,  using  the  AEG  theodolite  array  at 
Tonopah  NV  do  indicate  accuracy  deficiencies,  especially 
in  altitude.  Accuracy  tests. of  the  RMS/SCORE  and  the 
ACMR,  either  have  not  been  made  or  are  not  available  at  this 
time . 
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then  calibration  procedures  must  be  devised  which  would 
reconcile  the  deficiencies.  The  calibration  process 
probably  can  be  simplified  as  experience  with  the 
reliability/ repeatability  of  the  system  is  gained. 

A calibration  procedure  using  a reference  tracker 
appears  to  be  an  appropriate  choice  for  multilateration 
systems.  The  accuracy  potential  of  the  multilateration 
system,  about  20  feet  in  horizontal  measurements,  puts 
Stringent  accuracy  requirements  on  any  system  to  be  used 
as  a reference  tracker.  The  reference  tracker  itself 
must  be  calibrated  and  its  accuracy  verified  to  be  better 
than  that  required  of  the  multilateration  system.  Verification 
of  the  references  tracker  accuracy  requires  that  its 
tracking  accuracy  be  compared  against  another  tracking 
s'yBtem  at  least  as  accurate.  Comparison  against  a 
theodolite  array,  another  identical  but  autonomously 
calibrated  tracker  or  some  other  accurate  tracker  are  the 
verification  options.  The  verification  check  should  be 
oJ^"lj-ne  comparison,  to  insure  that  the  results  are  not 
weighted'  in  favor  of  either  system. 

A good  quality  microwave  tracker  is  one  potential 
option  for  a reference  tracker.  Coverage  of  the  multi- 
lateration systems  at  present  is  approximately  a fifteen 
nmi  radius  circle.  Assuming  the  reference  tracker  can  be 
hear  centrally  located,  then  it  must  achieve  an  angle 
accuracy  of  better  than  0.2  mr  (at  90,000  ft.,  0.2  mr 
borresponds  to  18  feet) . Compensation  must  be  provided 
for  range  and  elevation  angle  errors  caused  by  atmos- 
pheric refraction.  Refraction  can  cause  errors  of  tens 
of  feat  in  range,  and  over  a milliradian  in  elevation 
angle.  Adequate  range  accuracy  (1  to  2 yards)  should  be 
iachievcible.  Care  must  be  taken  in  calibration  to  align 
'the  tracker  properly;  i.e.,  level  of  "up"  (this  may 
Include  correction  to  achieve  true  up  if  gravity  leveling 
ds  used)  and  North.  Care  also  must  be  taken  to  avoid 
solar  heating  problems  (one  technique  used  is  to  enclose 
■'the  pedestal  within  another  closed  tower)  and  correct  for 
‘any  other  significant  error  sources.  Basically,  the 
required  calibration  accuracy  can  only  be  achieved 
if  meticulous  attention  to  detail  is  maintained  through- 
out the  calibration  process.  The  accuracy  achievable 
with  a high  quality  microwave  tracker  should  be  better 
than  0.2  mr  in  angle.  Kov^ever,  the  0.2  mr  accuracy  is 


142 


of  marginal  acceptability,  0.05-0.1  mr  is  a more  real- 
istic requirement,  since  some  multi lateration  system 
installations  may  be  considerably  larger  than  15  nmi 
radius.  The  post-flight  data  processing  normally 
employed  with  the  conventional  microwave  tracker  may 
compromise  its  utility  for  on-line  calibration  use. 

A precision  laser  tracker;  e.g. , the  Sylvania 
Precision  Automatic  Tracking  System  (PATS) , also  would 
be  a candidate  for  use  as  a reference  tracker.  Its 
precision  can  be  made  more  than  adequate,  such  that  its 
accuracy  will  only  depend  on  how  well  it  is  calibrated. 
Laser  radar  is  not  necessarily  synonomous  with  high 
accuracy.  For  example,  the  Sylvania  PATS  specifications 
imply  an  angle  accuracy  of  0.3  mr  for  target  tracking. 
However,  the  narrow  beamwidth  inherent  with  laser  trackers 
implies  a potential  for  highly  accurate  systems,  with  a 
side  benefit  of  very  good  low  angle  tracking  performance. 
Normally,  range  performance  must  be  augmented  through  the 
use  of  retro-reflectors  on  the  test/calibration  aircraft. 

Another  option  capable  of  satisfying  the  requirements 
for  a reference  tracker  is  the  on-axis  microwave  (or 
laser)  radar.  Extensive  attention  to  detail  in  observing 
errors  (including  time  and  time-tagging  errors) , error 
modeling  and  error  removal  as  part  of  the  calibration 
process  is  achieved.  Accuracy  of  the  order  of  0,05  mr 
has  been  demonstrated,  which  has  the  desired  result  of 
making  the  reference  tracker  considerably  more  accurate 
than  the  system  being  calibrated.  The  on-line  (in-loop) 
data  processing  used  with  the  on-axis  radar  yields 
accurate  (corrected)  metric  tracking  data  in  real  time. 

The  current  on-axis  implementation  also  has  a degree  of 
on-line  error  observability  (accuracy  verification)  due 
to  the  manner  in  which  the  boresight  telescope  is  used 
during  tracking.  Accuracy  of  the  on-axis  tracker  can  be 
verified  best  through  comparison  with  a separate,  auton- 
omously calibrated  on-axis  tracker,  either  an  optical 
tracker  or  an  identical  tracking  system.  The  on-axis 
trackers  should  have  considereible  utility  for  other  range 
tracking  functions  when  they  are  not  being  used  for 
calibration. 
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A theodolite  array  can  be  considered  for  use  as  a 
reference  tracker.  If  photographic  data  reduction  is 
employed,  then  it  is  only  useful  as  an  accuracy  verifi- 
cation technique;  i.e. , the  reduced  data  is  not  timely 
with  respect  to  calibration  needs.  An  on-line  cine- 
theodolite  system  would  be  needed  if  daily  calibration 
is  required. 

One  also  should  consider  the  possibility  of  extend- 
ing the  self-calibration  feature  of  multilateration 
systems  by  giving  them  the  capability  to  observe  their 
own  errors.  A possibility  for  doing  this  is  to  use  the 
tracking  data  generated  to  drive  (point)  an  accurately 
qalibrated  telescope  with  a video  display  in  the  multi- 
lateration system  control  van.  This  would  force  improve- 
ment in  the  error  modeling  until  the  telescope  could  be 
accurately  pointed  at  a target  under  track.  A second 
telescope  is  necessary  to  provide  triangulation  ranging 
and  facilitate  the  error  observation/error  modeling. 
Switching  also  could  be  provided  such  that  the  telescope 
could  be  selectively  pointed  at  any  of  the  high  activity 
targets  under  track,  thus  providing  an  on-line  capability 
of  verifying  tracking  accuracy  during  a mission.  Note 
that  the  telescope  is  not  used  like  a reference  tracker. 

It  is  a driven  system  which  provides  an  accurate  observa- 
tion of  angles  only  (no  range  information) . However,  it 
must  be  capable  of  being  independently  and  accurately 
qalibrated,  so  that  it  will  provide  an  indication  of  any 
error  in  the  data  supplied  to  point  it  at  a target  being 
tracked.  It  would  provide  an  accuracy  indication  con- 
sistent with  the  angle  resolution  of  the  telescope. 

For  at  least  one  application;  i.e.,  for  air 
combat  training,  the  multilateration  system  is  not 
required  to  have  absolute  accuracy.  Relative  accuracy 
between  aircraft  is  all  that  is  required.  This  relaxes 
the  calibration  requirements  for  aligning  the  multilatera- 
tion coordinate  system  in  a universal  sense;  i.e.,  up 
and  North,  and  for  establishing  an  absolute  reference 
height.  One  still  requires  assurance  that  measurements 
are  accurate  within  the  systems  own  established  co- 
ordinate system;  i.e.,  if  the  relative  position  between 
tv?o  aircraft  must  be  knox^m  to  an  RMS  accuracy  of  35 
feet,  then  the  RI'IS  accuracy  of  the  position  measurement 
of  each  aircraft  must  be  about  25  feet  relative  to  the 
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system  coordinates.  The  calibration  problem  is  approxi- 
mately the  same  as  discussed  above,  although  if  desir- 
able the  univeral  coordinate  system  used  by  the  refer- 
ence tracker  or  telescope  can  be  transformed  to  the 
multilateration  coordinate  system,  or  vice  versa. 

4. 6, 8. 2 Mistiming.  (Figure  4-30) 

Time  must  be  the  independent  variable  in  any  tra- 
jectory determination  process  (trajectory  = f(time) 
because,  if  timing  errors  exist,  all  other  calibration 
efforts  may  be  negated.  Investigation  of  trajectory 
measurement  systems  has  shovm  that  timing  associated 
errors  may  be  the  largest  single  contributor  to  poor 
accuracy.  An  attempt  will  be  made  to  explain  timing 
errors. 

Calibration  is  the  process  of  discovering,  sort- 
ing and  removing  error.  Calibration  is  permitted  to 
improve  accuracy.  Accuracy  is  a measure  of  the  close- 
ness to  the  true  value.  The  eOaility  to  produce  accurate 
trajectory  data  depends  on  the  cdsility  to  observe  the 
error  process  at  every  step  in  the  trajectory  produc- 
tion. A trajectory  is  defined  as  a composite  vector 
consisting  of  position,  velocity  and  acceleration  (TPVA) 
of  a vehicle  at  a given  epoch,  P,  V,  A » f(T).  If  the 
target  is  maneuvering  in  its  coordinate  frame,  then  a 
time  sequence  of  TPVA  is  necessary  to  describe  its 
trajectory.  The  epoch  is  most  often  expressed  as  time 
of  day.  It  is  the  accuracy  of  the  derivative  data  which 
ultimately  describes  the  accuracy  of  the  trajectory. 

It  is  important  that  any  data  to  be  processed  be 
linear,  since  most  of  the  processing  schemes  used  for 
Time-Space-Position  Information  (TSPI)  trajectory  meas- 
urement, such  as  least  squares  filtering,  may  not  func- 
tion properly  with  nonlinear  data. 

TSPI  data  unfortunately  are  frequently  very  non- 
linear due  to  external  noise  and  the  data  measurement 
process  itself.  Therefore,  one  is  much  better  off  if  one 
uses  a linear  processing  scheme.  To  assure  accuracy,  it 
is  necessary  that  the  effects  of  errors  in  any  of  the 
four  vectorial  components  be  observable  so  that  the  error 
growth  may  be  controlled. 
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Observability  is  the  ability  to  directly  inspect 
or  measure  the  closeness  to  the  true  value.  In  those 
cases  where  piecewise  or  total  observaibility  are  not 
inherent,  a measurement  system  may  be  improved  in 
accuracy  by  using  an  independent  device  to  do  the 
observing  for  it.  Very  little  observability  is  present 
in  data  processing  except  in  the  case  of  linear  systems 
wherein  the  superposition  principle  may  be  employed. 

a.  In  an  electronic  distributed  sensor  such 
as  a multilateration  system,  observability  is  prac- 
tically zero,  because  of  the  extensive  data  processing 
involved. 

b.  Observability  is  medium  in  a mechanical  system 
which  may  be  pointed,  such  as  radar,  until  data  are 
processed  for  correction.  During  data  correction, 
observcd)ility  is  zero. 

c.  Observability  is  high  in  a mechanical  system 
which  is  pointed  using  the  trajectory  data  because  the 
effect  of  data  processing  is  observable.  See  In- Loop 
Integration  Control  (ILIC) , Section  4, 6, 8. 2. 9. 

4. 6, 8. 2.1  Timing  Accuracy 

Accurate  timing  is  a necessary  part  of  any  tra- 
jectory determination  operation.  All  instrumentation 
must  have  time  available  to  the  instrument  to  time  tag 
the  data.  The  timing  accuracy  is  determined  by  the 
metric  accuracy  and  maximum  magnitude  of  the  time- 
position  derivatives  experienced  in  the  trajectory 
measurement  process.  Velocity  is  the  time-position 
derivative  which  generally  has  the  greatest  effect  on 
position  accuracy,  although  in  some  special  cases  the 
second  derivative  may  have  very  large  values.  Aircraft 
targets  moving  at  mach  II  will  be  observed  although  there 
are  inventory  aircraft  which  fly  faster.  Using  2000 
ft/second  as  the  aircraft  velocity,  two  aircraft  ap- 
proaching head-on  will  give  a good  estimte  of  the  meiximum 
closing  velocity  of  concern.  This  value  is  4000  ft/ 
second.  In  one  millisec  (10”^)  the  position  uncertainty 
due  to  time  errors  will  be  4 feet  which  is  too  large  if 
the  positional  accuracy  is  to  be  10  feet.  By  using 
10“^  second  as  the  timing  accuracy  requirement,  the 
target's  position  uncertainty  as  relating  to  time  error 
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will  be  0.4  feet,  which  is  an  insignificant  addition  to 
the  error  budget.  If  higher  velocities  are  experienced, 
then  greater  timing  accuracies  are  needed.  If  satellites 
are  to  be  tracked,  the  timing  in  accuracy  must  be  de- 
creased to  10”5  second  because  of  the  increased  velocity. 
Also,  if  the  positional  accuracy  is  significantly 
greater  than  10  feet,  greater  timing  accuracy  must  be 
considered. 


4. 6. 8. 2. 2 Timing  Errors 

Mistiming  is  composed  of  two  parts:  (1)  Time-of- 

day  generation  errors  and  (2)  Time-tagging  errors;  i.e., 
errors  associated  with  relating  time  to  position  and 
position  derivatives  for  a changing  trajectory.  Mis- 
timing could  be  classified  as  either  random  or  sys- 
tematic error,  however,  it  is  treated  here  as  a third 
category  because  timing  must  truly  be  the  independent 
variable  in  the  trajectory  process. 

a.  Time-of"Day  Errors.  A timing  error  is  related 
to  the  incorrect  time  of  "day  or  epoch.  Generally,  time 
of  day  is  expressed  in  an  Interrange  Instrumentation 
Group  (IRIG)  format,  of  which  there  are  several.  Timing 
cannot  be  assumed  accurate,  simply  by  consideration  of 
its  format  or  its  resolution.  Timing  should  be  checked 
and  evaluated  at  each  local  instrumentation  site,  pre- 
ferably at  the  instrument  itself.  Timing  errors  are 
readily  observed  by  comparing  the  local  time  as  given 
by  the  instrument  itself.  Timing  errors  are  readily 
observed  by  comparing  the  local  time  as  WW  and  LORAN  C. 
Using  LORAN  C,  errors  in  time  of  day  (TOD)  processes 
are  easily  constrained  to  10~5  second. 

Time-Tagging  Errors.  Time-tagging  errors 
are  more  difficult  to  detect  and  remove.  Time-tagging 
errors  can  be  divided  into  two  categories:  (1)  The 

coincidence  of  time  with  the  measured  components  of 
position,  and  (2)  The  time  coincidence  with  the  deriva- 
tives of  the  time-position  information;  i.e.,  velocity 
and  acceleration. 

c.  Time-Position  Errors.  A single  point  sensor 
system,  sucK'^a’i  a~raHaFT~uies~^  single  timing  strobe  to 
time  correlate  the  mensuration  data,  thereby  facilitating 
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time  tagging.  Other  instrumentation  systems,  such  as 
distributed  sensor  systems,  must  use  distributed  and/or 
sequential  timing  to  time  tag  their  nonorthogonal  com- 
ponents of  position.  In  this  case,  the  noisy  orthogonal 
components  of  position  must  be  computed,  a process  not 
conducive  to  correct  time  tagging.  Sequential  timing 
significantly  complicates  the  timetagging  process.  Even 
when  time  tagging  of  position  data  is  correct,  the 
trajectory  determination  process  deteriorates  because 
the  position  data  are  noisy.  Noisy  data  require  filter- 
ing in  which  an  average  position  and  an  average  time  are 
computed,  and  this  may  result  in  reduced  time-tagging 
accuracy. 

d.  Time-Position  Derivative  Errors.  By  far 
the  largest  time  errors  are  related  to  mistiming  of  the 
time-position  derivatives.  Correct  time  tagging  is 
important  in  all  applications,  but  becomes  critical 
if  the  derivative  data  are  used  on-line.  On-line  pro- 
cessing is  accomplished  in  a continuous  fashion  such 
that  data  are  processed  and  used  as  they  are  collected. 
On-line  processing  allows  for  zero  interpretation  of 
the  data  by  an  analysis,  in  constrast  to  off-line  pro- 
cessing at  some  later  period.  Incorrect  time  tagging 
of  position  derivatives  may  easily  allow  the  errtor  in 
using  the  incorrect  derivative  data  to  estimate  future 
epoch  velocities  and  positions  to  grow  with  little  con- 
straint. Time  tagging  of  velocity  and  acceleration 
data  from  a single  point  measurement  sensor  in  which 
all  components  of  position  are  orthogonal  and  measured 
rather  than  computed  is,  in  itself,  complicated.  Since 
differentiation  requires  use  of  several  position  measure 
ments  at  different  epochs,  it  is  difficult  to  know  what 
time  tag  should  be  attached  to  the  computed  derivative. 
The  problem  of  time  tagging  of  derivatives  is  very  much 
more  complicated  in  the  case  of  a nonorthogonal  measure- 
ment system  from  which  an  orthogonal  set  must  be  com- 
puted, especially  if  the  nonorthogonal  components  are 
measured  in  sequence  rather  than  at  a given  epoch.  An 
e^en  more  complicated  derivative  time-tagging  problem 
exists  in  a distributed  sensor  wherein  all  of  the  time- 
tagging difficulties  are  increased  by  synchronization 
and  transmission  problems. 
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4 . 6 . 8 . 2 . 3 Universal  Time  of  Day 

Prior  to  January  1972,  Tiniversal  time  tagging  was 
Subject  to  irregularities  caused  by  periodic  changing  of 
the  length  of  the  second  to  compensate  for  change  in 
earth  rate  due  to  \inpredictable  and  long-term  variations. 
The  variable  second  as  the  vinit  of  time  for  precision 
measurements  proved  to  be  unsuitable.  On  1 January  1972, 
the  universal  time  system  changed  from  an  earth  rotational 
time  system  to  a constant  second  system.  This  coordinated 
universal  time  (UTC)  is  the  internationally  agreed  upon 
time  and  is  the  basis  for  the  time  broadcast  by  WWV, 
iiORAN  C and  D.  Compensation  for  long-term  variations  is 
accomplished  by  occasionally  adding  or  dropping  a second 
when  enough  error  has  accumulated. 

Time-of-day  generation  is  broken  into  three  distinct 
f>arts:  (1)  The  external  synchronization  function;  (2) 

A free-running  precise  frequency  standard;  and  (3)  A 
time  code  generator. 

a.  The  synchronizing  function  is  done  directly 
with  WWV  and  LORAN  C or  D or  indirectly  through  range 
timing.  In  some  installations  where  LORAN  D is  not 
available,  a central  timing  facility  distributes  a local 
range  timing  as  the  synchronizing  source.  The  precision 
bf  the  WWV  transmitter  is  5 x 10~4  second  but,  because  of 
nonpredictable  propagation  anomalies  associated  with  the 
high  frequency  portion  of  the  radio  spectrum  over  which 
it  is  broadcast,  it  can  only  be  used  to  synchronize  local 
clocks  to  the  on-time  second.  LORAN  C or  D is  of  high 
precision  and  accuracy  (10"°  second)  at  the  transmitter 
site,  and  because  of  the  predictable  low  frequency 
propagation  at  100  Kz,  the  same  accuracy  is  attainable  to 
the  receiving  station  over  very  great  distances.  It  is 
not  necessary  that  the  synchronizing  signal  be  received 
continuously,  since  each  instrument  should  have  its  own 
free-running  clock  which  can  be  synchronized  whenever 
■external  time  is  available. 

b.  A stable  high-frequency  oscillator,  precise 
to  1 X 10"°  second  is  required  on  site  by  radars, 
theodolites,  telemetry,  etc.,  as  a source  for  time  count- 
ing. Generally,  this  high-frequency  time  is  generated 

on  site,  preferably  v;ithin  the  instrumentation,  rather 
than  by  transmission  to  the  site,  and  must  be  kept 
running  at  all  times. 
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c.  A time  code  generator  (TCG) , which  must  also 
be  kept  running  at  all  times,  correlates  the  free-running 
oscillator  with  the  external  time  source  and  confutes 
time  codes  which  represent  accurate  time  of  day  (TOD). 

4. 6. 8. 2. 5  Star  Observation 

Trajectory  instrumentation  frequently  has  the  capa- 
bility of  pointing  at  the  stars  for  calibration  purposes. 
By  pointing  at  the  stars,  the  local  instrument  can 
observe  and  remove  TOD  errors.  This  star  evaluation 
requires  a modification  of  the  time  of  day  to  UTl  and 
UT2.  UTl  is  UTC  corrected  for  the  effects  of  polar  axis 
variation,  while  UT2  is  smoothed  UTl  corrected  for 
seasonal  variations  in  the  earth's  rotation  rate.  The 
use  of  the  UTC  in  lieu  of  UT2  could  result  in  an  error  of 
13  arc  seconds  in  the  star  positions  used  to  calibrate 
the  sensor. 


4. 6. 8. 2. 5 Time-Tagging  Calibration 

The  association  of  time  with  measured  components  of 
position  must  be  observable  at  the  instrumentation  to 
assure  that  TOD  and  the  measured  parameters  are  all  time 
coincident.  This  step  in  the  process  is  one  requiring 
continuing  attention  to  assure  that  time  coincidence  is 
not  lost  through  routine  adjustments  and  repair  of  the 
instrument  and/or  its  recording  apparatus. 

4. 6. 8. 2. 6 Relative  Accuracy 

Degradation  of  accuracy  in  distributed  electronic 
systems  may  be  due  to  mistiming  or  position  errors. 

This  section  emphasizes  the  mistiming  considerations. 

Although  observability  is  mandatory  in  the  attain- 
ment of  accuracy,  the  standard  must  be  of  quality  that 
will  insure  universality.  Universality  implies  that 
any  other  accurate  instrument  can  use  the  data.  By 
the  same  token,  in  a distributed  sensor  field,  a system 
may  have  occasional  observability,  but  against  a non- 
universal  or  internally  consistent  standard  only. 

One  example  of  this  non-universal  standard  is  two 
systems  (e.g.,  aircraft  pods)  flying  within  a distributed 
sensor  field,  with  the  sensor  data  as  the  standard. 
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(See  Section  4. 6. 8. 1.3. 3.)  These  duplicate  pods  each 
contain  an  inertial  platform  to  supply  data  to  the 
distributed  system  and  are  installed  on  a single  air- 
craft. The  distributed  ground  system  produces  a tra- 
jectory (TPVA)  which  is  used  to  initialize  the  inertial 
data  on  a periodic  basis.  The  trajectory  may  be  totally 
divergent  as  far  as  universal  accuracy  is  concerned,  but 
can  be  made  to  give  constrained  answers  insofar  as  each 
pod  is  concerned  if  used  at  a near  simultaneous  epoch. 
Even  though  relative  accuracy  and,  in  particular, 
time-tagging  coincidence  may  be  demonstrated  by  two 
aircraft  flying  in  formation,  this  does  not  assure  even 
relative  accuracy,  as  the  two  or  more  targets  diverge 
from  a single  position.  Systems  are  being  engineered  in 
which  a single  pod  is  placed  on  each  aircraft,  and  the 
results  constrained  by  separately  derived  trajectories 
on-line. 

Relatively  large  numbers  of  targets  may  be  handled 
in  the  relative  accuracy  mode,  wherein  the  timing  error 
is  controlled  by  the  on-line  reinitialization  of  all 
position  vectors  at  near  common  epochs.  Two  on-line 
systems  which  operate  in  the  relative  rather  than 
absolute  accuracy  mode  are  the  (1)  Air  Combat  Maneuver- 
ing Instrumentation  (ACMI)  and  (2)  Multiple  Airborne 
Target  Trajectory  System  (MATTS) . The  ACMI  is  a multi- 
lateration  example  of  the  nonuniversal  accuracy  system, 
while  the  MATTS  is  an  electronic  angle  measuring  system 
employing  the  same  concept  and  is  sometimes  called  the 
electronic  theodolite  system.  Another  version  of 
multilateration  (time  of  arrival)  using  distributed 
electronic  sensors  is  the  Range  Measurement  System/Score 
(RMS) . 

When  the  data  produced  by  such  a distributed  sensor 
system  are  compared  to  an  external  system  such  as  a 
theodolite,  the  data  are  sure  to  diverge  because  of  the 
lack  of  observability  in  the  distributed  sensor  systems. 
It  is  important  to  realize  that,  although  such  a system 
as  described  can  be  made  accurate  in  the  universal 
sense,  it  is  frequently  not  attempted.  The  problem  is 
the  nonavailability  of  an  on-line  standard  against 
which  calibration  and  evaluation  may  be  observed.  A con- 
ventional radar,  either  microwave  or  laser,  which 
requires  a post  collection  error  correction  process, 
albeit  on  line,  should  be  considered  with  caution 
because  of  the  low  observability  in  the  data  correc- 
tion process.  If  the  data  from  the  radars  are  corrected 
off-line,  they  are  not  valid  calibration  standards. 
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4. 6. 8. 2. 7 Optimal  Calibrator 

A system  which  may  adequately  perform  the  uni- 
versal calibration  function  is  an  In-Loop  Integration 
Control  (ILIC)  radar,  either  microwave  or  laser.  It 
would  also  be  possible  to  use  an  ILIC  telescope  to 
evaluate  the  accuracy  of  a distributed  system;  however, 
for  an  ILIC  telescope  to  be  completely  adequate  from  a 
calibration  viewpoint,  both  systems;  i.e.,  the  distrib- 
uted sensor  system  and  the  telescope,  must  be  capable  of 
tracking  a satellite,  since  the  range  to  the  satellite 
may  be  computed  from  the  angular  measurements  made  by  the 
telescope  in  lieu  of  the  range  measurement  made  by  a 
radar.  Without  exception,  distributed  aperture  relative 
microwave  systems  require  a beacon  which  is  not  available 
in  current  satellites,  therefore,  prohibiting  distributed 
systems  from  tracking  satellites.  On-line  systems  should 
have  observability  of  their  own  total  trajectory  data; 
i.e.,  TPVA,  as  a calibration  standard.  A system  should 
be  used  which  can  be  checked  by  driving  a remote  sensor 
on-line  wherein  deviation  of  the  target  in  the  boresight 
defines  system  accuracy. 

4. 6. 8. 2. 8 Post-Flight  Process 

Since  the  ordinairy  sensor  can  only  measure  position 
or  its  components,  some  method  of  determining  time- 
position  derivatives  must  be  used.  An  estimate  of  the 
derivatives  may  be  obtained  from  three  time-position 
measurements  by  first  differences  (differentiation)  as 
shown . 


where  t = time 

X = position 
X = velocity 
X = acceleration 


Mathematically,  instantaneous  time-position  deriva- 
tives can  be  obtained  using  the  differentiation  process 
and  letting  the  time  interval  between  samples  go  to  zero. 
In  practical  measurements,  however,  one  cannot  by  dif- 
ferentiation calculate  the  correct  instantaneous  time- 
position  derivatives  in  a discrete  time  system,  but 
rather  always  derive  an  average  value.  In  the  presence  of 
noisy  measurement  data,  long  data  spans  are  required  to 
estimate  position  and,  therefore,  the  derivatives  probably 
never  represent  the  true  value  at  any  epoch.  The  ability 
to  correctly  time  tag  these  derivatives  becomes  improb- 
able if  not  impossible,  since  observability  approaches 
zero. 


If  target  acceleration  is  constant,  this  process 
is  valid  for  determining  the  average  value  but,  even 
in  this  restricted  sense,  what  is  the  correct  time  tag 
associated  with  this  average  derivative?  The  time- 
position  derivatives  are  always  produced  after  data 
collection  in  the  derivative  process.  The  situation 
is  in  a practical  sense  worse,  since  the  measurements 
are  noisy,  requiring  long  time  intervals  for  smoothing. 

If  the  target  is  not  flying  a constant  angular  velocity 
around  the  instrument,  the  target  always  accelerates  in 
the  frame  of  the  instriment,  causing  all  derivatives 
to  change,  thus  making  it  impossible  to  correctly  time 
tag  the  derivative  computed  data. 

4. 6. 8. 2. 9 In-Loop  Integration  Control  (ILIC) 

Process 

An  alternate  method  of  determining  a trajectory 
employs  an  In-Loop  Integration  Control  (ILIC)  process 
which  overcomes  many  of  the  difficulties  of  the  post- 
flight (differentiation)  process.  Of  particular  signif- 
icance is  the  fact  that  all  time-tagging  errors  are 
eliminated.  This  process  starts  by  using  a gross  estimate 
of  TPVA  dervied  by  the  differentiation  process  above;'  a 
double  integration  is  then  performed  on  the  acceleration 
(x)  to  arrive  at  a new  position  (Xj^)  . The  integration  is 
performed  over  a very  short  time  interval  (At)  which 
assures  that  the  updated  TPVA  components  all  occur  at  the 
same  epoch.  Assuming  the  second  derivative  (acceleration) 
is  constant  for  At  (example,  10"^  second)  then: 
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+ Atx 


where  x^^  = new  position 


and 


X. 

1 


^i-^  + Atx.  + X. 

X 2 ^ 


x^  = new  velocity 


The  sensor  (position  measure)  data  are  then  compared 
with  the  calculated  position  component.  If  the  position 
is  incorrect,  the  vector  is  adjusted  until  it  agrees. 

By  this  integration  process,  not  only  is  high  observ- 
ability attained  as  to  the  correctness  of  the  total 
vector,  but  correct  time  tagging  is  achieved. 

4.6.8.2.10  Summary 

Static  timing  errors  can  be  removed  by  observation 
and  comparison  with  an  accurate  time  broadcast,  while 
care  must  be  taken  with  dynamic  time  errors  (time  tagging) 
to  minimize  the  effect  on  trajectory  production.  Ob- 
servability of  the  correctness  of  the  time  tagging  is 
achievable  through  use  of  the  In-Loop  Integration  Control 
technique  described  above. 

4.7  COMMAND  AND  CONTROL 

Command  and  Control  elements  necessary  for  remge 
safety  and  efficient  direction  of  activities  will  vary 
from  simple  and  austere  to  complex  and  costly  as  a 
function  of  the  variety  of  missions  to  be  performed, 
scored,  and  recorded.  Surveillance  and  instrumentation 
radar  information  must  be  transmitted  and  displayed 
to  range  operators.  Automation  of  f\onctions  will  be 
required  to  present  meaningful  information  in  a format 
suitable  for  use. 

There  are  meiny  aspects  to  range  command  and  control. 
This  section  discusses  several  topics/programs  related 
to  command  and  control,  but  does  not  attempt  to  address 
the  totality  of  command  and  control.  The  following 
subsections,  by  title,  are: 
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Range  Instrumentation  for  Control  and  Scoring  (RIGS) 

Signal  Evaluation  Analysis  and  Prediction  System 
(SEAPS) 

Frequency  Management 

Electromagnetic  Compatibility  (EMC) 

Killed  Element  Removal 

4.7.1  Range  Instrumentation  for  Control  and  Scoring 
(RICS) . (Figure  4-3l) 

As  a result  of  the  considerations  contained  herein 
a concept  has  evolved  for  a standardized  but  modular 
mobile  or  portable  control  center  for  use  in  range 
operations  at  various  levels  of  range  centralization. 

It  includes  display,  communications,  and  computer 
facilities  for  the  basic  requirement  for  a control 
center,  which  include; 

Mission  Control 
Air  Traffic  Control 
Mission  Evaluation 
Range  Safety  and 
Environment  Management 

Incorporation  of  a modular  concept  in  the  RICS 
design  will  allow  inclusion  of  Time/Space/Position 
Information  (TSPI)  systems  in  the  selected  configura- 
tion where  the  required  data  are  not  available  from 
associated  facilities.  For  example,  a primary  and 
secondary  radar  for  air  traffic  control  and  surveil- 
lanba  can  be  included  as  well  as  TSPI  systems  such 
as  a tracking  radar  or  special  scoring  systems  for 
the  specific  missions. 

Communications  facilities  may  also  be  utilized 
on  a modular  basis  including  wire  and  radio  elements 
for  voice,  printer,  and  data  communications  with  as- 
sociated switching,  recorders,  etc.,  as  appropriate 
to  the  echelon  level  of  the  particular  RICS  installa- 
tion. 
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Figure  4-31 
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Suitable  mobile  or  portable  power  generator  vmits 
will  be  available  if  required  for  either  primary  or 
secondary  use  power  supply. 

The  RIGS  concept  has  not  yet  evolved  as  a definite 
system  configuration,  but  its  usefulness  for  range 
operations  is  evident  and  its  development  should  be 
pursued. 

4.7.2  Signal  Evaluation  Analysis  and  Prediction 
System  (SEAPST.  (Figure  4-32) 

4. 7. 2,1  General 


a.  Effective  utilization  and  training  of 
aircrews  in  the  use  of  electronic  countermeasures 
equipment  in  a broad  category  of  USAF  Operational 
Training,  Testing  and  Evaluation  (OTT&E)  missions  have 
been  dependent  exclusively  upon  the  resultant  effects 
observed  in  threat  simulator  receiving  systems. 

b.  The  utilization  of  electronic  warfare  equip- 
ment, threat  simulators,  and  supporting  systems  require 
operation  in  major  portions  of  the  Electromagnetic 
spectrum  also  used  by  numerous  non-participating  and 
protected-participant  users  is  severe. 

4. 7. 2. 2 Objectives 

The  objectives  of  the  SEAPS  system  are:  To  provide 

a modular  multi- function  low-cost  receiving/processing 
system  to  evaluate  aircrews  in  the  use  of  ECM  equip- 
ment, and  assess  the  impact  of  EM  activities  from  the 
viewpoint  of  Electromagnetic  Compatibility  (EMC)  and 
minimum  Radio  Frequency  Interference  (RFI)  to  other 
spectrum  users. 

4. 7. 2. 3 System  Description 

In  general  the  SEAPS  operating  system  would  encom-. 
pass  the  following  modular  elements: 

a.  Premission  EMC  Analysis.  The  assessment 
of  proposed  EM  activity  scenarios  upon  the  EM  user 
environment . 
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b.  Spectrxxm  Surveillance.  The  interception, 
processing  and  display  of  real-time  EM  environment 
activities. 


c.  Emission  Validation.  The  utilization  of 
intercepted  signals  in  the  environment  from  RF  emitters 
(primarily  threat  radar  simulators)  to  verify  that  the 
emissions  are  valid  replications  of  the  threat  simulated. 
This  element  is  primarily  a range  maintenance  function 
for  the  threat  simulators. 

d.  Electronic  Warfare  Scoring.  The  utiliza- 
tion of  Spectrum  Surveillance  data  composed  of  threat 
emissions  and  corresponding  aircrew  and  EW  equipment 
responses  to  assess  the  effectiveness  of  EW  activities. 

e.  Radio  Frequency  Interference.  The  utiliza- 
tion of  actual  Spectrum  Surveillance  data,  emitter 
locations,  susceptible  receiver  system  data  and  inter- 
action parameters  to  assess  RFI  problems  and,  if  re- 
quired, control  EW  emission  activities. 

Figure  4-32  depicts  the  above  operational  character- 
istics of  the  SEARS. 

4 . 7 . 2 . 4 System  Flexibility 

From  the  above  description  of  system  capability, 
several  system  applications  are  evident  at  no  additional 
hardware  cost. 

a.  TEMPEST  (COMSEC) . The  measurement  and 
-analysis  of  signal  correlated  EM  data  to  ensure  TEMPEST 
security  in  accordance  with  NASEM  5106  and  5110. 

b.  Jammer  Management.  Utilization  of  inter- 
cepted spectrum  data  to  assess  the  effects  and  manage 
the  effectiveness  of  multiple  jammers  on  radar/com- 
munications  systems. 

c.  EMC./EMI  Testing.  Data  collection  of  spurious 
radiation  spectrum  signature  data  for  MIL-STD-449,  461, 
462  and  469  purposes. 


d.  EM  Assessment.  Utilization  of  intercepted 
spectrum  activities  to  assess  and  notify  personnel  of 
RFI  from  hostile  activities  to  communications  and  radar 
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systems  and  impacts  upon  command  structure.  This  could 
include  notification  of  required  frequency  changes  to 
avoid  hostile  ECM  and  the  resultemt  impact  to  the  system 
operation. 

4. 7. 2. 5 Conclusion 

The  SEAPS  will  monitor,  assess  and  notify  operator 
personnel  of  the  status  of  the  EM  environment  to  allow 
optimal  execution  of  USAP  OTT&E  operations  and  EW 
scoring  while  simultaneously  insuring  interference-free 
communications  and  spectrum  usage  to  non-participant  and 
protected-participant  EM  users. 

4.7.3  Frequency  Management.  (Figure  4-33) 

4. 7. 3.1  General 

A principal  electromagnetic  interference  (EMI) 
control  technique  available  is  Frequency  Management. 
Frequency  management  offices  may  exercise  other  control 
techniques  including  Time,  Location,  and  Direction  Man- 
agement to  ensure  electromagnetic  compatibility  (EMC) 
of  the  OTT&E  environment. 

4. 7. 3. 2 Objectives 

The  objectives  of  frequency  management  programs  are 
to  ensure  the  electromagnetic  compatibility  of  an 
existing  electromagnetic  (EM)  environment  in  which 
OTT&E  missions  utilize  portions  of  the  EM  spectrum. 

4. 7. 3. 3 Approach 

The  responsibility  for  acquiring  frequency  assign- 
ments for  military  and  other  government  agencies  within 
the  Continental  US  falls  upon  the  frequency  control 
officer  in  the  region  in  which  the  OTT&E  activity  will 
occur.  EMI  control  options  available  to  the  EM  planner 
and  frequency  control  officer  in  making  frequency  as- 
signments are  presented  in  Figure  4-33.  These  options 
are: 


a.  Frequency  Management 

b.  Time  Management 
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FIGURE  4-33 


c.  Location  Management 

d.  Direction  Management 

4. 7. 3. 3.1  Frequency  Management 

As  shown  in  Figure  4-33  receivers  represent  the 
victims  of  EMI  emissions.  Since  there  can  be  no  inter- 
ference problems  without  susceptibility  of  receivers, 
they  must  be  considered  as  well  as  their  transmitting 
counterparts.  The  objective  of  emission  control  is  to 
operationally  maintain  transmitters  so  that  they  occupy 
the  least  frequency  spectrvmi  possible.  RF  modulation 
bandwidth  should  be  no  greater  than  that  necessary  to 
accommodate  the  transmission  base-band  intelligence. 

4. 7. 3. 3. 2 Time  Scheduling 


Time  management  emphasizes  the  temporal  aspects  of 
EMI  control.  One  aspect  of  time  management  is  time 
sharing  of  one  or  more  frequency  bands  among  several 
users  having  different  interests.  Sometimes  this  may 
be  achieved  on  a non-interference  basis  in  which  one 
user  has  priority  during  certain  hours  of  the  day  but 
other  users  may  also  use  that  band  during  this  period  on 
a not-to-interfere  basis.  Where  two  or  more  radars  use 
the  same  frequency,  a master  oscillator  or  distributed 
timing  sources  with  LORAN  synchronization  may  be  util- 
ized to  trigger  the  radars  according  to  a scheduling 
plan  which  will  avoid  interference  among  them. 

4. 7. 3. 3. 3 Location  Management 

Location  management  refers  to  EMI  control  by  the 
location  of  a transmitter  or  victim  receiver  with  respect 
to  other  emitters  or  receivers  in  the  EM  environment. 

If  separation  and  terrain  shielding  are  utilized, 
significant  reduction  in  EMI  is  possible. 

4. 7. 3. 3. 4 Direction  Management 

Direction  management  refers  to  the  technique  of 
EMI  control  by  utilizing  terrain  masking,  sector  blank- 
ing, antenna  bearawidth  and  polarization  of  EM  propaga- 
tive waves  to  a receiver  system,  to  reject  or  minimize 
interfering  transmitter  sources. 
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4. 7. 3. 3. 5 Implementation 

The  EMI  control  options  above  may  be  integrated 
into  one  system  effort  which  includes  prediction, 
planning  and  real-time  control.  Such  a proposed  system 
to  assist  Frequency  Management  offices  is  described 
in  the  Signal  Evaluation  Analysis  Prediction  System 
(SEAPS)  section  of  this  document. 

4 . 7 . 3 . 4 Simimary 

As  the  use  of  the  radio  frequency  spectrum  expands, 
the  introduction  of  OTT&E  electromagnetic  emission 
r'equirements  into  the  environment  may  create  hazardous' 
interference  conditions.  Options  are  available  in  the 
EMI  design,  application  and  EM  planning  to  integrate 
OTT&E  spectrum  usage  requirements  into  the  existing 
Environment.  The  successful  completion  of  this  inte- 
gration will  be  required  before  any  OTT&E  missions  or 
equipment  procurement  would  be  allowed  due  to  the 
potential  effects  upon  other  spectrum  users. 

4.7.4  Electromagnetic  Compatibility  (EMC) . 

4. 7. 4.1  General 


The  required  compliance  of  electrical  and  elec- 
tronic equipment  with  electromagnetic  interference 
(EMI)  specifications  or  requirements  is  intended  to 
assure  electromagnetic  compatibility  (EMC) . EMC  is  the 
Characteristic  of  equipment  and  systems  to  operate  as 
designated  without  degradation  or  malfunction  in  their 
intended  operational  electromagnetic  (EM)  environment  or 
adversely  affecting  any  other  equipment  or  systems. 
Control  and  prediction  of  EMI  should  take  place  at  the 
earliest  stages  possible  of  the  life  cycle  of  equipment 
or  a system  as  well  as  in  OTT&E  mission  planning.  There 
are  many  EMI  controls  that  may  be  carried  out  in  system 
and  equipment  design,  deployment  and  operation. 

4. 7. 4. 2 Objectives 

The  objective  of  an  EMC  control  program  is  to 
ensure  that  USAF  OTT&E  programs  are  executed  with 
minimum  scenario  restriction  and  optimum  flexibility 
for  the  OTT&E  participants. 
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4. 7. 4. 3 Approach 


OTT&E  progrcims  and  missions  utilizing  communica- 
tions electronic  and  weapons  systems  utilize  major 
portions  of  the  radio  frequency  spectrvan  commonly  shared 
by  multiple  non-participant  users.  The  operational 
environment  of  weapons  test,  electromagnetic  counter- 
measures, and  training  areas  represent  one  of  the  most 
complex  EM  environments  in  the  world.  Three  essential 
phases  of  an  EMC  control  program  are  required.  These 
are: 

a.  EMC  analyses. 

b.  Real-time  EMC  assessment. 

c.  Post-mission  EMC  documentation. 

4. 7. 4. 3.1  EMC  Analysis 

EMC  Analysis  includes  a complete  detailed  analyti- 
cal assessment  of  the  proposed  EM  spectrum  activities  at 
the  earliest  phases  of  system  and  operations  planning. 

This  assessment  may  be  provided  in-house  or  by  the 
Electromagnetic  Compatibility  Analysis  Center  (ECAC) . 

ECAC  can  provide  extensive  assessment  in  all  phases 
of  EMC  prediction  and  frequency  utilization. 

4. 7. 4. 3. 2 Real-Time  EMC  Assessment 

Real-time  EMC  assessments  are  required  due  to 
scenario  variations  which  may  be  exercised  by  partici- 
pants. Pre-mission  analysis,  predictions  and  resultant 
planning  are  insufficient  for  achieving  complete  EMC  in 
an  OTT&E  environment  where  optimum  EM  engagement  scenarios 
are  required. 

An  EMI  real-time  control  program  is  necessary  to 
detect  and  solve  these  problems  which  will  arise,  even 
though  not  previously  exposed  by  analytical  predictions. 
The  capabilities  of  a real-time  EMC  analysis  and  pre- 
diction system  are  further  described  in  Section  4.7.2  of 
this  document. 
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4. 7. 4. 3. 3 Post-Mission  EMC  Analysis 

Post-mission  EMC  analysis  will  include  documenta- 
tion of  OTT&E  EM  activities  and  correlation  with  range 
test  data.  Files  update,  frequency  management  booking, 
EM  data  base  acquisition  and  interference  reports  will 
be  "required  for  range  documents  and  a part  of  post- 
mission EMC  analysis. 

4. 7. 4. 4 Conclusion 

As  the  use  of  radio  frequency  spectrum  expands,  the 
need  for  a comprehensive  EMC  program  for  OTT&E  users  is 
paramount.  Early  EMI  identification  based  upon  system 
definition  and  objectives  is  essential.  The  integratioh 
between  EMC  analysis  and  subsequent  EMC  management 
tedhniques  is  mandatory  to  system  operation  and  inte- 
gration into  the  existing  electromagnetic  environment. 

4.7.5  Killed  Element  Removal 


4 . 7 . 5 . 1 Background 

In  many  exercises,  simulated  weapons  deliveries 
will  be  scored  rather  than  actual  deliveries.  These 
ex?ercises  may  involve  use  of  electronic  countermeasures, 
including  tactical  mutual  support  formations.  Con- 
tinued participation  of  an  element  after  it  has  been 
killed  would  influence  later  activities  and  cause 
misinterpretation  of  the  results. 

4. 7. 5. 2 System  Description 

The  evaluation  of  the  effectiveness  of  the  pen- 
etrating force  during  a large  scale  exercise  will  depehd 
upon  real-time  scoring  of  simulated  weapons  employed  by 
both  sides.  When  an  aircraft  or  ground  element  is 
killed,  immediate  action  must  take  place  to  note  the 
event  and  to  reduce  the  effects  of  the  continued  pres- 
ence of  the  killed  element. 

4. 7. 5. 3 Alternatives 

a.  No  Element  Removal.  In  some  cases  the  killed 
element  may  be  left  in  the  scenario  for  training  pur- 
poses. This  is  a valid  alternative  only  if  an  evaluation 
is  not  required. 
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b.  Procedural  Renvoval.  In  this  alternative, 
the  killed  element  Caircraft)  initiates  a pre-briefed 
procedure  to  exit  the  exercise  area  upon  notification 
that  it  has  been  killed. 

c.  Complete  Notification.  Here,  in  addition 
to  notifying  tne  killed  element  of  its  status,  all 
participants  that  may  be  affected  are  also  notified. 

This  includes  ground  or  air  units  that  have  been  en- 
gaging or  supporting  the  killed  element.  For  killed 
aircraft  this  will  be  done  by  marking  the  data  sent  to 
each  threat  site  for  scoring  so  the  killed  element  can 
be  flagged  as  no  longer  participating.  At  the  same 
time,  the  killed  aircraft  should  produce  a visual 
indication  of  its  status,  such  as  smoke.  This  will 
indicate  to  other  airborne  elements  and  optically 
directed  ground  elements,  such  as  AAA  units,  that  the 
target  is  killed.  Upon  notification  the  killed  aircraft 
will  cease  all  EW  activities,  and  initiate  pre-briefed 
exit  procedures.  Until  a capability  for  real-time 
scoring  of  simulated  air-to-grovind  weapons  deliveries 

is  available,  it  will  not  be  possible  to  remove  killed 
groiind  elements.  Visual  indication  of  aircraft  kill 
cannot  be  provided  without  adding  a pod  or  making  some 
aircraft  modification. 

d.  Other  Factors.  To  maximize  training,  methods 
to  reinsert  killed  elements  into  the  exercise  in  a manner 
that  does  not  affect  the  evaluation,  must  be  considered, 

4.8  COMMUNICATIONS 

Communications  development  must  consider  electro- 
magnetic compatibility  along  with  a possible  need  for 
data  encryption.  Decentralized  versus  centralized 
processing  of  time,  position,  velocity  and  accelera- 
tion data  will  have  a significant  impact  on  communica- 
tions channel  and  bandwidth  needs.  Commonality  of  com- 
munication equipment  will  produce  significant  reduction 
in  development  and  acquisition  costs  and  reflect  the 
maintenance  and  operations  training  needs. 

This  section  addresses  several  topics  which  must 
be  considered  in  the  design  of  a range  communications 
system,  i.e. , organization  of  the  data  bus  for  TSPI 
data  transmission,  COMSEC  and  encryption  requirements. 
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4.8.1  Data  Transmission 


A range  system  is  used  for  the  gathering,  movement, 
and  production  of  test  data.  The  data  are  generally 
used  for  evaluation  of  an  external  system.  Range  com- 
plexity varies  from  the  relatively  simple  RBS  sites  for 
bombing  targets  to  the  very  large  complexes  such  as  Eglin 
AFB,  Eastern  Test  Range  (ETR)  or  the  satellite  control 
facility  network.  Many  forms  of  communication  are  needed 
for  any  given  range;  e.g.,  target  trajectory  (TPVA) , and 
identity  for  the  scoring  force  (White) , range  C^,  house- 
keeping, threat  complex  c3,  telemetiry  attacking  (Blue) 
force  and  external  (FAA)  range  inputs.  However,  this 
paper  will  be  specifically  directed  to  a discussion  of  a 
concept  for  handling  TSPI  data  only,  since  on  many  ranges 
it  is  the  major  data  item. 

A common  method  of  implementing  a range  data  system 
has  been  to  simply  connect  each  instrument  to  a control 
center  for  processing.  Normally,  this  approach  came 
about  when  the  range  just  grew  in  function  rather  than 
by  design.  Transmission  to  a control  center  requires  a 
high  quality  (and  possibly  high  bandwidth)  full  duplex 
data  link  from  each  instrument  into  a central  processor. 
There  are  technical  reasons  for  avoiding  this  which  are 
addressed  in  Section  4.9.2.  Obviously  the  central 
processor  becomes  a funnel  through  which  all  data  must 
pass.  Often  this  will  cause  long  time  delays  in  making 
data  available  where  needed  or  in  making  data  available 
after  a mission.  Critical  data  processing  either  may  not 
get  done  or  may  have  unacceptable  delays.  A solution  to 
this  is  to  go  to  distributed  processing  (as  discussed  in 
Section  4.9.2). 

This  section  discusses  a TSPI  data  bus  concept  which 
is  complementairy  to  the  distributed  processing  concept. 
With  the  data  bus  concept,  all  instruments  and  the 
central  processor  are  tied  together  through  the  data 
bus  as  illustrated  in  Figure  4-34.  This  figure  also 
shows  off-range  communications  going  through  the  central 
control.  This  is  important  to  control  off-range  command/ 
control  influences  on  range  operation. 

The  data  bus  concept  requires  a distributed  data 
processing  system.  Each  instrument  location,  including 
search  radars  and  IFF  as  well  as  the  high  resolution 
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DATA  BUS 


FIGURE  4-34 


instruments  normally  tied  into  a data  bus  are  required 
to  process  their  data  into  a common  format  and  be  capable 
of  data  comparisons  between  their  data  and  data  on  the 
same  target  on  the  data  bus.  All  targets  would  be 
assigned  an  identification  number  (normally  the  aircraft 
tail  number)  which  would  remain  with  the  target/partic- 
ipant throughout  the  mission.  The  ID  number  must  be 
assigned  by  the  control  center.  Each  target  would  have  a 
single  data  slot  on  the  data  bus,  even  though  many 
instruments  may  be  tracking  the  target  at  any  given  time. 

A microprocessor  (see  Section  4.9.2. 3)  at  each  instrument 
would  compare  any  data  on  the  bus  with  the  instrument's 
own  track  data  on  the  target.  If  the  instrument  data  is 
better,  then  it  is  substituted  for  that  on  the  bus  and  is 
immediately  available  to  all  other  sensors  (and  central 
control)  on  the  data  bus.  Data  precision  estimates  are 
carried  with  the  data  on  the  bus  to  facilitate  decision 
making  relative  to  data  quality  and  data  substitutions. 
Good  calibration/registration  between  systems  is  a 
prerequisite  for  successful  data  bus  operation.  The  data 
bus,  in  turn,  facilitates  the  needed  calibration/registra- 
tion  because  a continuing  comparison  is  possible.  The 
data  bus  concept  requires  that  data  error  correction  be 
done  on-site  to  assure  registration  and  be  on-line  due  to 
the.  data  comparison  requirements.  Data  correction  at 
the  instrvument  is  preferable  in  any  case  due  to  there 
being  more  information  available  at  the  instrument  than 
can  be  conveniently  transmitted  to  another  location. 

Calibration  validation  is  facilitated  with  the 
data  bus.  Track  data  comparison  with  data  on  the  bus 
is  built  in.  If  the  data  from  the  system  to  be  validated 
agrees  with  the  accurate  data  on  the  same  target  on 
the  data  bus,  then  the  system  is  calibrated.  If  it 
does  not  agree  then  suitable  corrections  on-site  must 
be  made  to  yield  agreement. 

Data  Bus  Format.  The  trajectory  description  of 
a maneuvering  target  must  include,  time,  position, 
velocity  and  acceleration.  If  the  target  is  maneuver- 
ing then  the  data  rate  for  updates  is  a factor.  It 
is  expected  that  TPVA  at  ten  sample s/second  is  adequate 
to  describe  the  flight  path  (trajectory  of  aircraft 
encountered  in  today's  environment).  Of  course,  if  the 
target  is  flying  straight,  level,  and  not  accelerating 
along  its  thrust  vector,  then  much  lower  data  rates 
are  possible.  The  prime  consideration  is  how  soon  the 


170 


system  can  sense  a change  from  straight  and  level  to  a 
maneuvering  mode.  If  the  input  sensor  is  a six  rpm  IFF, 
then  a maneuver  may  be  detected  within  thirty  seconds. 

With  a tracking  radar,  a maneuver  may  be  detected  at  the 
one-tenth  second  data  rate.  The  data  stream  should  be 
made  up  of  multiples  of  75  bits/second  to  insure  that 
the  data  are  excryptable  and  will  normally  be  2400  baud. 
Higher  data  rates  of  4800  and  9600  baud  are  alternatives. 
As  an  example,  within  each  240-bit  TPVA  word,  time  could 
use  35  bits  and  resolve  one  millisec  per  year.  Position 
use  of  26  bits  gives  a component  resolution  of  one  foot, 

26  bits  for  velocity  yields  a resolution  of  .5  ft/sec, 
while  11  bits/component  for  acceleration  gives  .5  ft/sec^. 
Target  identity  is  assigned  12  bits,  giving  4906  options 
and  is  compatible  with  IFF/SIF  identification.  This 
excunple  would  thus  use  200  bits  for  a data  word.  It 
is  not  likely  that  more  stringent  resolution  requirements 
will  be  placed  on  any  one  segment  than  was  used  for  the 
example.  The  data  should  be  carried  in  a universal 
coordinate  system;  i.e.,  geocentric  or  a subset  thereof. 
(See  Section  4.9.1.) 

4,8.2  Communications  Security  (COMSEC) 

The  objectives  of  a COMSEC  program  for  OTT&E  range 
improvement  are  to  apply  the  maximum  practicable  degree 
of  protection  to  all  range  telecommunications  systems. 
COMSEC  includes  the  following  security  elements; 

a.  Transmission. 

b . Cryptographic . 

c.  Emission. 

d.  Physical  security  of  COMSEC  materials  and 
information. 

4.8,2. 1 Background 

Air  Force  telecommunications  at  OTT&E  ranges 
throughout  the  world  are  prime  targets  for  foreign 
intelligence  activities  and  are  being  exploited  to  some 
degree  depending  upon  the  susceptibility  to  intercept, 
level  of  encryption,  usefulness  for  intelligence  purposes 
and  the  information  content  of  data  being  transmitted. 
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4. 8. 2. 2 Approach 

At  this  time,  total  encryption  of  telecommunica- 
tions is  not  practical.  However,  each  command  is 
responsible  for  identifying  encryption  requirements 
and  for  initiating  actions  that  are  necessary  to  satisfy 
COMSEC  requirements. 

4. 8. 2. 3 Recommendations 

All  telecommunications  networks  and/or  systems  used 
to  transmit  information  of  possible  intelligence  value 
which  is  not  classified  in  individual  transmissions, 
but  which  reveals  classified  information  when  collec- 
tively compiled  and  correlated,  must  be  considered  for 
on-line  encryption. 

Air  Force  Security  Service  (AFSS)  will  provide 
assistance  in  determining  the  sensitivity  and  vulner- 
ability through  test  and  evaluation  (TEMPEST)  and 
recommend  a priority  for  encrypting  telecommunications 
links . 

4. 8. 2. 4 Telecommunications  Areas 

The  general  telecommunications  areas  for  COMSEC 
include; 

a.  Voice  communications. 

b.  Data. 

c.  Telemetry. 

d.  Television/Facsimile. 

All  must  be  considered  as  vulnerable  elements  and  ana- 
lyzed for  potential  with  respect  to  foreign  exploitations 
whenever  they  are  integral  to  an  Air  Force  weapons  system 
test. 
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4. 8. 2. 5 Conclusions 

Coordination  of  COMSEC  requirements  with  AFSS  and 
establishment  of  a COMSEC  education  program  are  essential 
to  communications  security  objectives.  This  education 
program  must  be  designed  to  relate  to  the  duties  and 
responsibilities  associated  with  the  command  mission 
and  functional  assignments.  It  must  insure  that  each 
person  recognizes  COMSEC  objectives  and  requirements. 

4.8.3  Encryption 

The  need  for  protection  from  hostile  intelligence 
activities  can  be  partially  achieved  through  encryption 
of  susceptible  information  transmitted  between  system 
elements. 

4. 8. 3.1  Background 

In  almost  every  case  where  encryption  is  necessary, 
conflicts  of  interest  arise.  A realistic  threat  environ- 
ment may  be  needed  to  test  system  hardware  yet  may 
reveal  intelligence  capabilities.  System  voice  com- 
munications may  indirectly  yield  test  objectives  and 
system  capability  but  require  system  hardware  modifica- 
tions to  incorporate  voice  encoders.  Data  transfer 
systems  may  require  a multitude  of  user  system  input/ 
output  equipment  such  that  communications  and  encryption 
device  costs  may  be  prohibitive. 

4. 8. 3. 2 Decision  Elements 

a.  Total  Encryption.  If  all  communications 
were  encrypted , there  would  be  no  capability  to  in- 
corporate intelligence  activities  and  communications 
jaitming  into  tests  and  all  of  these  potential  users 
would  be  denied  use  of  the  system.  Aircraft  not  pre- 
sently equipped  with  secure  voice  communications  would 
require  this  new  capability.  This  impacts  both  system 
configuration  and  realism. 

b.  Partial  Encryption.  Partial  encryption  of 
sensitive  data  systems , evaluation , and  operator  com- 
mentary are  presently  the  most  feasible  approach  to 
system  security.  The  problems  of  feasibility  and  cost 
are  less  severe  than  with  total  encryption. 
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c.  No  Encryption.  The  most  desirable  approach 
to  system  configuration  from  the  range  standpoint  would 
be  complete  clear  text  transmission  of  all  data  with 
only  minimal  or  no  enciryption.  This  approach  allows 
maximum  range  realism  but  compromises  system  security 
against  hostile  exploitation.  Some  of  the  exploitation 
potential  may  be  mitigated,  however,  by  such  ploys  as 
using  threat  data  formats  similar  enough  for  realism, 
but  different  enough  to  not  reveal  intelligence  cap- 
abilities. Considering  all  aspects  of  information 
security  versus  realism,  this  approach  may  prove  to  be 
the  most  practical. 

4. 8. 3. 3 Recommendations 

In  general,  the  corresponding  merits  which  must  be 
incorporated  to  provide  the  capability  for  system 
encryption  are  of  benefit  to  digital  systems  and  costly 
to  analog  systems.  For  exctmple,  if  TDM/PCM  communica- 
tions modulation  techniques  are  used  to  provide  a bulk 
encryption  capability,  modems  associated  with  FM/FDM 
carrier  systems  are  not  required.  Voice  and  analog  data 
transfer  are,  hov;ever,  costly  in  terms  of  bandwidth 
requirements  for  TDM./PCM  commxinications  links.  If  the 
system  is  configured  to  provide  on-site  evaluations  and 
a central  system  only  providing  correlation,  analog 
data  transfer  should  be  minimal.  Short  haul  communica- 
tions could  be  achieved  with  hard-line  and  millimeter 
communication  data  links  without  resorting  to  encryption. 

4 . 9 RANGE  SUPPORT 


This  segment  of  TT&E  range  equipment  and  manage- 
ment covers  all  support  and  peripheral  areas  not  included 
under  other  specific  requirements.  Among  these  are 
such  elements  as; 

Facilities 

Maintenance 

Logistics 

Operations 

Some  of  the  significant  special  subjects  are  covered 
in  the  subsections  which  follow. 
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4.9.1  Coordinate  Systems.  CPigure  4-35) 

4. 9. 1.1  General 


The  Air  Force  OT&E  and  training  ranges  are  char- 
acterized by  a wide  spectrtim  of  capabilities  (inst3na- 
mentation)  and  geographical  extent  Cland  and  airspace) , 
Capabilities  may  vary  from  little  or  no  instrumentation; 
e.g.,  a range  for  practice  bombing  runs,  to  a highly 
instrumented  range  complex,  possibly  consisting  of 
several  threat  terminal  defense  areas,  air  combat  arenas, 
air-to-ground  scoring  ranges,  etc.  There  can  be  a cor- 
responding variation  in  the  land  and  airspace  available. 
For  instrumented  ranges,  one  must  look  at  trade-offs  and 
choose  a range  coordinate  system  or  systems  best  suited 
to  the  range  needs.  It  is  the  intent  here  to  familiarize 
the  reader  with  a cross-section  of  coordinate  systems  and 
identify  some  of  the  trade-offs  involved  in  coordinate 
system  selection. 

A common  coordinate  system (s)  for  the  interchange 
of  data  among  a geographically  dispersed  network  of  radar 
and/or  other  sensor  systems  constituting  the  range 
instrumentation  is  desirable.  A correct  selection  of  a 
common  coordinate  system  will  significantly  reduce  the 
bookkeeping  required  for  range  command/control,  and 
allow  use  of  data  on  multiple  targets  by  range  sensors 
as  needed.  Comparison  of  data  from  one  sensor  with 
another,  as  is  required  for  scoring  and  calibration,  is 
facilitated  if  a common,  appropriate  coordinate  system 
is  used.  But  just  how  much  flexibility  is  available? 
Threat  terminal  defense  areas,  if  threat  simulators  and 
simulation  are  involved,  will  be  forced  to  work  in 
a coordinate  system  which  is  at  least  similar  to  that 
used  by  the  defense  system  being  simulated.  Range 
operation  inevitably  involves  an  exchange  of  data  with 
the  FAA  regional  air  traffic  control  (ATC)  system.  The 
FAA  has  an  esteiblished  coordinate  system  (stereographic) 
and  data  format  for  exchange  of  data  within  their  own 
system,  with  which  the  range  must  interface.  Never- 
theless, a common  coordinate  system  for  interchange  of 
tracking  data  within  the  range  is  feasible,  although 
threat  system  data  formating  and  coordinating  system 
use  will  be  different  within  the  threat  c3  structure. 
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Use  of  a common  coordinate  system  for  all  data 
interchange  implies  a need  for  a computer  (or  a trans- 
formation "box")  at  each  instrumentation  site  capable  of 
transforming  from  the  instrviment  coordinate  system  to 
the  common  range  coordinate  system  and  a reverse  trans- 
formation for  data  sent  to  the  site.  For  computational 
convenience  the  common  coordinate  system  should  be  an 
orthogonal,  rectilinear  system  (Cartesian) . Two  im- 
portant aspects  which  must  also  be  considered  are  the 
location  of  the  coordinate  system  origin  and  the  orienta- 
tion of  the  components. 

4. 9. 1.2  Range  Coordinate  System 

Many  different  coordinate  systems  will  be  in  use  on 
a test  range,  extending  from  several  types  of  sensor 
coordinate  systems  to  coordinate  systems  which  would 
have  utility  for  data  interchange  among  instrumentation 
sites  and  range  control.  Figure  4-35  illustrates  the 
spectrum  of  coordinate  systems  that  may  be  used  by  a 
single  instrument,  in  this  case  using  an  azimuth  over 
elevation  mount,  which  utilizes  the  stars  in  calibra- 
tion. Figure  4-36  shows  some  typical  alternatives 
available  for  OTT&E  use. 

The  sensor  coordinate  system  is  imbedded  within 
the  sensor,  which  is  mounted  on  the  instrument.  Up-down 
and  left-right  associate  with  the  angle  sensing  portion 
of  the  receiver,  and  in-out  with  positioning  the  re- 
ceived pulse  within  the  receiver  range  gate.  Each  of 
the  sensor  coordinates  are  then  transformed,  using  range 
and  angle  encoders,  to  the  instrument  coordinate  system — 
range,  azimuth,  and  elevation  (R,  A,  E) . This  coordin- 
ate system  is  of  little  utility  for  data  exchange  with 
other  range  entities,  but  is  the  natural  one  for  use 
within  the  instrument.  A number  of  items  associated 
with  error  correction/calibration  and  tracking  with  the 
instriment  must  be  done  in  this  coordinate  system. 

These  include; 

- Removal  of  atmospheric  refraction  effects 
(actual  computation  of  the  effect  involves  use  of  a 
topo spheric  model  of  the  earth,  not  shown  in  Figure 
4-35) . 
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- Zero  setting  of  encoders. 

- Corrections/additions  for  non-orthogonality 
of  axes,  droop,  skew,  encoder  non-linearity,  apparent 
acceleration,  etc. 

- Instrument  display. 

For  this  exeimple,  the  data  is  then  transformed 
to  a topocentric,  XYZ,  coordinate  system,  centered  at  the 
instrument.  This  references  the  data  to  a coordinate 
system  in  a form  where  it  can  be  useful  to  external  users 
of  the  data.  Information  identifying  the  source  of  the 
data  and/or  the  instrument  location  must  accompany  the 
data.  For  orientation,  gravity  level  is  used  as  a 
secondary  standard  for  "up,"  with  corrections  added 
on-line  to  establish  agreement  with  stellar  observations. 
Encoder  offsets  for  North  and  East  are  also  determined  to 
correctly  align  the  X and  Y axes.  This  coordinate  system 
is  convenient  for  map-type  displays. 

Three  geocentric  (earth  centered)  coordinate  systems, 
each  with  its  own  special  utility  to  the  instrument  also 
are  shown  in  Figure  4-35:  Geodetic,  EFG,  and  Celestial. 

Geodetic  is  defined  relative  to  a reference  ellipsoid 
description  of  the  earth  and  is  used  to  locate  points  on 
the  earth's  surface.  The  instrument  location  is  deter- 
mined in  a geodetic  coordinate  system  via  a survey. 
Locational  components  are  latitude,  longitude,  and  height 
(above  the  reference  ellipsoid) , Worldwide,  there  are 
several  different  reference  ellipsoids  in  use;  e.g.. 
International  ellipsoid  of  1924,  Clarke  1866  spheroid, 
the  Bessel  1941  ellipsoid,  Fischer  ellipsoid  of  1960,  and 
the  DOD  World  Geodetic  System  of  1966.  The  survey  should 
indicate  which  reference  ellipsoid  was  used  so  that  the 
small  differences  can  be  accounted  for,  if  necessary. 
Three  different  measures  of  latitude  are  defined:  geo- 
detic, geocentric,  and  astonomical.  The  geodetic  lati- 
tude (used  by  survey)  at  a point  on  the  earth's  surface 
is  the  angle  between  the  equatorial  plane  and  a line 
through  the  point  normal  to  the  reference  ellipsoid. 
Similarly,  the  geocentric  latitude  (used  when  pointing  at 
a star)  is  defined  by  a line  through  the  point  from  the 
earth's  center  and  the  astronomical  latitude  by  a line 
coincident  with  local  gravity  at  the  point. 
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The  EFG  is  an  othogonal,  linear,  earth  centered 
coordinate  system  as  shown  in  Figure  4-35.  A non- 
rotating earth  is  used.  The  EFG  coordinate  system  is 
universal  in  the  sense  that  data  users  need  not  be 
concerned  with  location  parameters  of  the  data  gener- 
ating site.  Location  and  orientation  parameters  of  the 
using  site  are  all  that  are  needed. 

Finally,  the  celestial  coordinate  system  of  Figure 
4-35  is  necessa'ry  to  allow  calibration  on  the  stars.  A 
rotating  earth  is  used.  Star  locations,  each  defined  by 
two  angles  in  this  coordinate  system,  are  found  in  a 
star  catalog  (e.g.,  U.S.  Navy  FK-4) . Appropriate  star 
locations  must  be  mapped  back  through  the  coordinate 
systems;  i.e.,  to  EFG,  to  topocentric,  to  instrument  to 
sensor,  for  use  in  calibration.  Note  that  the  sensor 
Coordinate  system  used  in  this  case  is  one  associated 
with  a boresight  telescope  mounted  on  the  same  instru- 
ment; e.g.,  on  the  radar  elevation  trunnion. 

Minimal  radar  implementation  allows  use  of  the 
sensor  and  instrument  (RAE)  coordinate  systems.  Some 
means  of  transformation  is  needed;  e.g.,  a computer 
or  special  purpose  device,  if  data  mapping  to  or  from 
other  coordinate  systems  is  desired. 

Other  generic  types  of  position  measuring  devices 
will  employ  a set  of  coordinate  systems  suited  to  their 
needs.  For  example,  each  of  the  sites  in  a theodolite 
"array  will  employ  an  up-down,  left-right  sensor  co- 
ordinate system,  which  is  transformed  on  site  to  an 
^instrument  azimuth-elevation  coordinate  system.  Com- 
putation, normally  a combination  of  manual  and  computer 
operations  (but  sometimes  automated  on-line)  is  then 
used  to  geometrically  solve  for  position  in  a topo- 
centric, XYZ  coordinate  system.  Similarly,  a multi- 
lateration  system  uses  reinge  only  data  from  a number  of 
sites  to  compute  position  in  an  XYZ  coordinate  system. 
Note  that  in  our  examples , the  first  common  type  of 
coordinate  system  encountered  is  the  XYZ.  In  each  case 
discussed,  these  are  local  systems  with  the  origin  at  or 
within  the  instrument  (for  the  distributed  system, 
flexibility  in  locating  the  coordinate  system  origin  is 
usually  available) . 
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Correctly  relating  the  location  and  orientation  of 
each  instrument  to  the  common  coordinate  system  is 
imperative.  This  can  be  accomplished  only  if  the  ori- 
entation of  each  instrument  and  its  location  relative  to 
other  instrument  sites  and  the  coordinate  system  origin 
can  be  accurately  determined.  This  is  facilitated  if  the 
instrument  XYZ  system  is  related  to  EPG  (via  a rotation/ 
translation) . 


4. 9. 1.3  Coordinate  System  Selection  Criteria 

The  coordinate  systems  of  Figure  4-35  are  illustra- 
tive of  the  generic  types  of  coordinate  systems  that 
might  be  considered  for  a common  range  system.  Most  are 
inappropriate  for  a range  system  for  Interchange  of 
tracking  data.  Data  in  the  instrument  coordinate  system 
must  be  transformed  to  be  useful  anywhere  other  than  at 
the  instrument  itself.  It  is  possible,  however,  to 
transmit  data  in  the  instrument  coordinate  system  and  do 
the  transformations  to  some  "common"  system  at  the 
central  control  facility.  Implementation  of  this  ap- 
proach means  that  for  each  instrument,  central  control 
must  also  transform  tracking  data  to,  be  sent  to  the 
instrument;  e.g.,  acquisition  data  or  tracking  data  for 
scoring,  into  the  instrument  coordinate  system.  Identi- 
fication of  the  sending  instrument  must  accompany  the 
data  so  that  the  appropriate  transformation  can  be 
applied.  This  can  be  either  implicit,  if  point-to-point 
dedicated  channels  are  used,  or  by  coding  a sender 
identity  in  the  data  stream.  This  approach  puts  all  of 
the  burden  on  one  or  more  centrally  located  computers  and 
operation  of  any  portion  of  the  rauige  will  depend  on  the 
operational  status  of  this  computer  and  associated 
communications  links.  Direct  interchange  of  tracking  data 
between  instrumentation  sites  is  not  possible  if  this 
technique  is  used. 

The  geodetic  coordinate  system  is  non-linear  and  is 
cumbersome  for  use  with  tracking  data.  However,  it  must 
be  used  by  the  range  for  all  survey  locations.  The 
survey  location  should  be  transformed  into  a more  con- 
vienent,  cartesian  system  for  use.  The  celestial  co- 
ordinate system  cannot  be  used  for  trajectory  data,  since 
a line  orientation  rather  than  a position  is  defined. 

It  has  utility  only  as  an  intermediate  step  for  those 
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instruments  which  use  the  stars  for  calibration.  The  two 
options  capable  of  satisfying  range  needs  for  a common 
system  are;  (1)  A Cartesian,  geocentric  coordinate 
system;  e.g.,  EFG,  and  (2)  Some  version  of  a topo- 
centric  coordinate  system,  the  location  and  orientation 
of  which  are  referenced  to  a geocentric  coordinate 
system. 

Two  possibilities  for  a common  topocentric  coor- 
dinate system  for  display  purposes  warrant  discussion. 

One  is  a Cartesian  XYZ  system,  as  shown  in  Figure  4-35 
(TOPO)  expanded  to  cover  the  area  of  interest.  The 
second  is  the  stereographic,  which  is  widely  used  by  the 
FAA  as  a regional  coordinate  system.  Either  of  these  two 
possibilities  allows  direct  use  of  the  "X,  Y"  values  for 
map-like  display  purposes.  Map-distortion  is  present 
with  either  system  (although  at  tolerable  levels)  but  is 
less  with  the  stereographic  system.  The  third  dimension, 
H,  in  the  stereographic  representation  is  defined  as 
height  above  a curved  earth.  It  is  directly  relatable  to 
the  output  of  aircraft  barometric  altimeters  without 
further  computation. 

A test  range  can  expect  a high  volume  of  data 
exchange  wj.th  the  FAA.  This  data  exchange  should  be 
with  range  control  (as  should  be  the  case  with  all 
non-range  entities).  Thus,  since  some  other  coordinate 
system  is  "best"  for  range  use,  it  would  not  be  xinrea- 
sonable  to  have  range  control  do  whatever  transformations 
are  necessary  for  data  exchange  with  the  FAA.  The 
equations  for  transformation  from  a local,  instrument  XYZ 
system  to  stereographic  are  somewhat  more  complex  than 
transformation  to  an  expanded  XYZ  with  a different 
origin. 

Transmission  of  data  with  either  system  does  not 
require  sender  identification. 

Although  it  would  not  constitute  a common  range 
system,  use  of  several  XYZ  coordinate  systems  for  cases 
where  there  are  natural  sxabdi visions  of  the  range;  e.g., 
geographically  distinct  areas,  possibly  instrumented  for 
different  types  of  test  missions,  is  also  a possibility, 

A separate  XYZ  system,  referenced  to  a geocentric  co- 
ordinate system,  could  be  used  for  each  geographically 
distinct  area,  with  the  coordinate  system  origin  somer- 
where  within  the  area.  All  tracking  instrumentation 
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within  the  area  would  transform  to  the  area  XYZ  system 
for  data  transmission.  This  transformation  is  identical 
to  the  one  necessary  to  go  to  the  common  XYZ  discussed 
above,  except  that  the  data  word  lengths  are  less  due  to 
the  smaller  area.  Data  transmissions  to  range  con- 
trol would  require  identification  of  the  area  of  origination 
of  the  data,  either  by  coding  with  the  data  or  by  association 
with  dedicated  communication  channels.  Direct  inter- 
change of  data  cimong  sites  is  possible  within  the  area 
itself,  which  is  where  the  primary  need  exists. 

A number  of  geocentric  coordinate  systems  are  in 
use;  e.g.,  fixed  and  rotating  earth  sperical  and  Cartesian 
systems,  the  Keplerian  orbital  system,  and  the  geodetic 
and  celestial  systems  already  discussed  above.  There  is 
no  need  for  a rotating  earth  coordinate  system  for 
aircraft  test  ranges  and  the  computational  complexity 
is  a disadvantage  of  the  spherical  systems,  thus  the 
fixed  earth  Cartesian  system  is  the  likely  geocentric 
system  with  potential  for  use  as  a common  range  system. 

The  EPG  system  depicted  in  Figure  4-35  is  recommended  as 
a global  (or  universal)  system  for  interchange  of  tra- 
jectory data  (TPVA)  in  IRIG  103-69.  Thus,  if  a geocentric 
system  is  chosen  as  the  common  range  system,  it  should 
be  the  EFG  system.  This  would  permit  interchange  of  data 
without  further  coordinate  transformation,  assuming  that 
the  other  ranges  also  adopt  the  EFG  system. 

In  the  EFG  system,  each  target  point  is  uniquely 
defined  and  there  is  no  need  to  identify  the  originator 
of  trajectory  data,  only  the  user  location  need  be 
known.  The  EFG  system  is  designed  to  accommodate  points 
anywhere  around  the  world.  Data  expressed  in  the  EFG 
coordinate  System  are  not  directly  useful  for  display 
purposes  and  must  be  transformed  to  an  earth  surface 
system  for  display  use.  Word  length  is  greater  by  four 
or  five  bits  for  each  coordinate  than  is  the  case  for  a 
common  XYZ  coordinate  system. 

4.9.2  Data  Processing 

There  are  many  types  of  sensors/instruments  pro- 
ducing data  for  OTT&E  missions.  Often  these  sensors  do 
not  produce  data  which  is  directly  useful  eind  processing 
is  required  to  convert  the  data  to  useful  form.  This  may 
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be  for  displays  for  range  control  (e.g.,  target  track 
data,  together  with  alphanumerics  and  grids/maps) , data 
for  frequeny  control  and  management,  etc.  Data  proces- 
sing is  the  means  whereby  raw  range  data  is  converted  to 
useful  form  and/or  analyzed. 

One  example  of  data  processing  for  filtering,  smooth- 
ing or  prediction  is  shown  in  Figure  4-37.  Invariably 
the  data  measurement  process  is  noisy  and  processing  is 
required  to  control  or  remove  the  noise.  Since  the 
processing  is  generally  non-linear,  extreme  care  must 
be  exercised  to  assure  appropriate  answers.  Non-linear 
processing  is  not  well  understood  and  some  means  of  ob- 
serving or  verifying  the  validity  of  the  processing  out- 
put is  needed.  Lack  of  such  observability,  except  in  the 
use  of  linear  processing,  is  one  of  the  reasons  for  the 
Idrge  errors  seen  in  many  systems. 

Not  too  long  ago,  much  of  the  data  processing  was 
done  using  limited  function  analog  devices.  In  recent 
years,  more  and  more  of  the  processing  has  been  trans- 
ferred to  digital  processors.  Digital  processors  offer 
a -greatly  expanded  capability,  generally  at  lower  cost, 
and  overcome  many  of  the  limitations  of  analog  devices, 
such  as  drift. 

Digital  machines  have  expanded  our  test  capability, 
particularly  for  large-scale  exercises,  but  also  for 
small-scale  tests.  Use  of  digital  processors  allows 
correlation  of  many  events,  even  when  very  dissimilar. 

Use  of  elaborate  display  techniques,  often  allowing 
flexibility  in  changing  formats,  is  facilitated.  In- 
struments can  be  allowed  to  operate  in  their  natural 
coordinate  systems  with  the  digital  devices  providing 
transformations  to  and  from  a universal  coordinate  system 
for  other  uses,  such  as  control,  without  significant 
round-off  errors.  Digital  processors  offer  the  potential 
for  providing  much  of  the  test  evaluation  on-line  while 
the  mission  is  being  run  in  contrast  to  collecting  large 
amounts  of  data  for  later  analysis. 

There  are  pitfalls  associated  with  the  greatly  ex- 
panded capability  offered  by  using  digital  processors. 
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There  is  a tendency  for  some  to  believe  the  output  is  cor- 
rect simply  because  it  was  produced  by  a big  computer. 
However,  the  answers  produced  can  easily  be  either 
correct  or  very  wrong.  It  is  up  to  the  user  to  verify 
the  accuracy  of  the  outputs  to  avoid  drawing  wrong 
conclusions  about  a test  environment  or  vehicle  due  to 
incorrect  data.  Care  must  be  taken  to  avoid  collecting 
large  amounts  of  data  only  to  find  out  later  that  the 
data  are  incorrect  and,  hence,  useless.  It  is  even  worse 
to  then  use  the  incorrect  data  simply  because  it  is  all 
that  is  available. 

4. 9. 2.1  Validation  of  Processing 

Verification  of  output  accuracy  is  a serious  pro- 
blem in  using  digital  processors.  An  approach  to  solving 
this  problem  is  to  break  the  process  into  small  pieces 
that  can  be  checked.  Specifically,  to  move  as  much  of 
the  processing  as  possible  to  small,  special  purpose, 
single  function  processors.  Input/output  relationships 
can  be  established  for  each  of  the  small  processors  to 
assist  in  ensuring  the  accuracy  of  the  total  process. 

When  these  small  processors  are  implemented  with  firm- 
ware (see  Section  4. 9. 2. 3),  the  process  cannot  be  changed 
easily.  After  verifying  the  process  for  correctness, 
only  routine,  operational  checks  need  be  made. 

4. 9. 2. 2 Distributed  Processing 

This  is,  of  course,  advocating  a form  of  distributed 
processing.  There  have  been  large  scale  attempts  to  do 
all  range  processing  in  one  or  more  big  computers  at  a 
central  control  location.  Large  software  routines 
governed  by  a complex  executive  prograim  are  necessary. 

The  executive  program  alone  often  takes  up  a large  part 
of  the  available  memory.  In  addition,  the  central 
processor  may  over-cycle  in  the  on-line  process  and  incur 
significant  data  delays  or  even  bog  down.  Some  of  this 
can  be  alleviated  by  moving  processes  out  of  the  one  big 
machine  whenever  possible  into  small,  special  purpose 
processors  (distributed  processing  at  the  central  control 
facility) . 
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A natural  extension  of  this  is  to  move  as  much  of 
the  processing  as  is  practical  to  the  remote  sensor 
locations.  It’s  really  a matter  of  deciding  where  in  the 
process  to  logically  transfer  data  between  locations. 
Logically  a significant  amount  of  the  processing  should 
be  done  at  the  remote  sensor  location,  since  more  in- 
formation is  available  there.  Data  needed  by  the  central 
processor  to  provide  the  control  function  can  then  be 
sent  over  relatively  narrow-band  data  channels.  The  data 
sent  would  consist  primarily  of  TSPI  and  result  data, 
such  as  scoring  results.  All  relevant  data  should  be 
recorded  on  site  for  detailed  post-flight  review/pro- 
cessing if  needed.  This  approach  allows  flexibility  in 
terms  of  future  expansion  requirements. 

4. 9. 2. 3 Microprocessors 

Figure  4-38  illustrates  a few  of  the  functions  which 
may  be  performed  by  special  purpose  microprocessors  to 
help  alleviate  the  load  on  the  control  data  processor. 
Microprocessors  can  be  used  to  advantage  either  at  cen- 
tral control  or  the  instrument.  For  reduced  scale  opera- 
tion, all  of  the  control  processing  may  be  done  at  the 
instrument. 

Recent  developments  with  microprocessors  have 
reversed  the  process  of  building  bigger  and  more  com- 
plicated digital  data  processors.  When  much  of  the  data 
processing  was  analog,  usually  each  function  was  accom- 
plished in  a unit  designed  for  a specific  operation.  As 
digital  computers  were  developed,  more  and  more  func- 
tions were  done  in  the  computer  with  increasing  reliance 
on  software  programming.  It  is  now  possible,  using 
microprocessors,  to  again  do  many  of  the  processes  with 
units  designed  for  the  specific  operations.  This  type  of 
non-programmable , digital  hardware  is  called  firmware. 

Its  use  allows  the  design  engineer  to  again  do  total 
system  design  rather  than  turning  large  parts  of  it  over 
to  the  software  programmer.  It  has  become  easy  to  use 
digital  firmware  and  easy  to  change  the  firmware  if  the 
right  equipment  is  available.  Computers  have  become 
faster,  and  effectively  larger,  because  many  of  the 
functions  previously  done  in  software  are  now  done  in 
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peripheral  fisnnware  devices.  Any  well  defined  process 
can  and  should  be  done  by  a microprocessor,  leaving  only 
the  less  well-defined  processes  to  be  accomplished  via 
software.  Firmware  devices  are  small,  low  cost  and  are 
not  readily  changeable  in  the  field  without  special  equip- 
ment. Their  use  helps  make  each  piece  of  the  process 
functionally  checkable,  thus  making  it  easier  for  the 
user  to  validate  results.  Many  non-iterative  processes 
do  not  require  the  power  of  a microprocessor  and  should 
be  done  with  the  hardware  cards. 

Figures  4-39,  4-40,  and  4-41  show  special  purpose 
microprocessor  cards  for  processor,  memory  and  program 
storage  modules.  These  are  fairly  elaborate  relative 
to  the  needs  of  many  of  the  functions  mentioned.  How- 
ever, they  can  be  made  more  or  less  complex  as  required. 

Some  functions,  particularly  for  large  scale  ex- 
ercises, are  still  best  done  in  a central  processor. 

These  include  total  system  testing,  system  status,  kill 
removal,  test  planning,  any  required  post  flight  analysis 
and  on-line  exercise  control  functions. 

4.9,3  Displays 

One  of  the  primary  uses  of  displays  is  for  rapid, 
composite  communication  between  man  and  machine.  Dis- 
plays have  come  to  be  a vehicle  for  the  user  to  observe 
missions  in  detail,  on-line  or  soon  after,  without 
waiting  for  computer  processing  and  print-outs.  Often  a 
display  may  include  more  information  than  cein  easily  be 
assimilated  in  real-time  and  tbe  user  may  want  to  selec- 
tively play  back  portions  for  reviewing.  A common  type 
of  display  is  a map-like  display  showing  aircraft  posi- 
tion. For  some  uses  it  may  be  desirable  to  also  have  the 
map-like  display  show  range  boundaries,  geographical 
features,  ordnance  footprints  (for  safety  decisions), 
alphanumerics  to  augment  target  positional  information, 
expected  flight  paths  or  other  information  of  interest  to 
a particular  user.  Other  displays  may  be  needed  for  such 
things  as  equipment  status  or  to  display  expected  versus 
actual  electromagnetic  radiation  for  the  spectrum  man- 
agement and  control  officer.  There  are  many  other 
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possible  display  requirements.  Proper  use  of  displays  is 
important  to  progress  towards  achieving  a real-time  range 
capability.  Much,  if  not  all,  of  the  display  information 
must  be  recorded,  partly  for  user  mission  review  for  more 
complete  assimilation  of  information,  but  also  in  case  of 
failures  or  itccidents. 

There  are  a large  number  of  display  options  avail- 
able to  the.  range  designer.  Chosen  displays  should  show 
all  of  the  data  needed  to  functionally  evaluate  or  con- 
trol the  process  of  concern  and  should  meet  operational 
as  well  as  analytical  needs.  More  data  than  is  critical 
to  the  mission  itself  should  be  displayed,  e.g.,  cali- 
bration data,  etc.,  with  the  mission  critical  data  being 
emphasized  by  using  color  or  flashing  or  some  other 
technique.  Use  of  computer  driven  displays,  with  the 
capeibility  to  change  data  and/or  format  at  user  command, 
yields  considerable  flexibility  and  may  allow  a reduction 
in  the  number  of  displays. 

Requirements  for  record/playback  should  help  dictate 
the  selection  of  display  itself  should  impose  minimal 
special  requirements  on  playback  equipment,  e.g.,  use  of 
standard  525  line  TV  recording  allows  playback  at  any 
location  without  special  equipment. 

For  a given  application  the  type  of  display  needed 
will  be  partly  dictated  by  the  type  of  data.  The  data 
may  be  either  digital,  such  as  TSPI  data,  or  analog, 
e.g.,  radar  video  or  optical  boresight  TV  video.  The 
selection  of  electronic  display  types  available  include 
roster  scan  TV,  direct  driven  cathode  ray  tubes,  alpha- 
nvimeric,  etc.  Mechanical  or  manual  plotting  boards  are 
also  still  in  use.  Record  and  playback  dictates  the  use 
of  electronic  displays.  Reconstruction  of  a mission  via 
playback  requires  that  data  as  well  as  video  be  recorded. 
Alphanximerics  can  be  added  easily  to  a TV  display  for 
both  on-line  and  playback  use.  Direct  driven  cathode  ray 
t\ibe  displays  are  well  adapted  to  digital  data  and/or 
graphics,  but  not  to  analog  data.  Any  of  the  electronic 
displays  can  be  remoted  if  desired.  To  the  extent  that 
they  are  computer  (or  microprocessor)  driven,  there  can 
be  great  flexibility  in  changing  data  and/or  format  in 
accordance  with  user  commands. 


TSPI  (target  trajectory/TPVA)  displays  utilize  dig- 
ital data  and  a direct  driven  cathode  display  can  be 
used.  For  some  applications  this  data  will  be  displayed 
as  a map-like  display  with  alphanumerics  included  to 
provide  identification,  height,  direction  of  movement, 
velocity,  etc.  Maps  or  geographies  may  be  overlayed. 

The  display  projection  can  be  anything  desired,  e.g. 
Mercator,  st^reographic  (as  used  by  FAA)  or  a polar 
Version  (as  used  with  a PPI) . Three  dimensional  displays 
are  also  possible,  with  the  view  angle  and  perspective 
scaling  accomplished  by  a microprocessor  in  accordance 
with  operator  commands.  Recording  of  these  types  of 
displays  can  be  done  using  a scan  conversion  to  a roster 
scan  for  play  back  on  standard  television  equipment. 

4.9.4  Flight  Simulators 

The  usefulness  of  flight  simulators  as  a technique 
for  enhancing  aircrew  training  is  well  established  and 
documented  in  the  June  1974  edition  of  the  "Air  Force 
Master  Plan,  Simulators  for  Aircrew  Training",  ASD/XR 
Report  Number  74-22.  The  energy  shortage,  the  esca- 
lating costs  of  aircraft  procurement  and  operation,  and 
the  need  to  extend  the  life  of  operational  aircraft 
emphasizes  the  requirement  to  accelerate  improved  simu- 
lator capabilities  and  expanded  utilization  in  order  to 
ireduce  actual  flight  time  requirements  with  their  associated 
fcosts.  The  present  Air  Force  master  plan  for  simulators 
fcovars  the  aircrews  training  problem  quite  adequately. 
However,  the  use  of  simulators  as  an  adjunct  to  opera- 
tional testing  is  not  addressed.  The  following  discus- 
sion covers  the  potential  exploitation  of  existing  and 
progreimmed  flight  simulators  to  enhance  operational 
testing  and  evaluation. 

4. 9. 4.1  Flight  Simulators  Technology 

This  section  addresses  flight  simulation  technology. 
Areas  covered  are  as  follows: 

- current  technology 

- functional  systems 

- development  areas 
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4, 9. 4. 2 Current  Technology 

Flight  simulator  technology  falls  into  three  basic 
areas;  Cockpit  instrumentation.  Motion,  and  Visual.  The 
capability  to  accurately  simulate  cockpit  layouts,  the 
operation  of  basic  flight  instruments,  avionics,  radar 
etc.  has  been  well  established  for  some  time.  Current 
versions  of  simulators  for  the  P4  and  A7  aircraft  provide 
very  good  instrument  simulation. 

Motion  simulation  continues  as  an  area  of  consider- 
able debate.  Numerous  studies' have  been  performed  which 
strongly  support  the  position  that  motion  is  required  to 
provide  necessary,  meaningful  cues  to  the  pilot. 

State  of  the  art  motion  systems  provide  relatively 
large  amplitude  excursions  with  six  degrees  of  freedom. 

A relatively  new  development  in  this  area  is  the  G-seat — 
a cockpit  seat  lined  with  air  bellows  which  are  dif- 
ferentially inflated  to  exert  pressures  on  the  body  which 
correlate  to  those  experienced  in  flight  by  gravity  forces. 
The  use  of  a G-seat  is  usually  combined  with  a G-suit 
worn  by  the  pilot. 

It  should  be  noted  that  motion  systems  represent 
finite  size  and  weight  limitations  on  simulation  hard- 
ware. 


Visual  simulation  continues  as  the  most  difficult 
of  the  flight  simulation  technologies;  it  has  the  most 
problem  areas  and  is  the  subject  of  considerable  ongoing 
development  effort. 

Virtually  all  simulators  available  today  are  re- 
garded as  part  task  trainers — this  designation  is  gov- 
erned primarily  by  limitations  of  the  visual  system.  On 
a given  simulator,  only  a limited  number  of  visual  tasks, 
can  currently  be  simulated  and  normally  only  one  major 
area  (air-to-air  combat--air-to-ground  weapons  delivery, 
takeoff  and  landing,  night  landing,  etc.)  can  be  simu- 
lated well.  Users  are  currently  demanding  full  mission 
simulators  which  are  capable  of  doing  all  things  using  a 
single  cockpit.  This  capability  is  not  currently  within 
the  state  of  the  art. 
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Numerous  cockpit  displays  have  been  developed  and 
are  in  common  use  now  which  differ  considerably  in  terms 
of  both  performance  and  cost.  Display  fields  of  view 
range  from  approximately  60  degrees  (CRT  driven  mirror 
beamsplitter  used  for  takeoff  and  landing  simulation— 
ceamsplitter  used  for  takeoff  and  landing  simulation) 
to  angles  which  virtually  duplicate  the  available  field 
of  view  from  our  most  modern  fighter  aircraft.  Both 
real  image  and  infinity  image  (virtual  image)  displays 
are  in  use.  Color  systems  have  been  built  having  fields 
of  view  up  to  120  degrees.  However,  color  systems  cur- 
rently suffer  from  lack  of  detail  resolution  which  can 
be  provided  by  monochrome  systems. 

Three  sources  are  commonly  in  use  today  for  inputs 
to  the  visual  system.  Models  (of  terrain  or  target  air- 
craft imagery)  are  the  most  common  visual  image  source. 
Some  systems  currently  use  computer  generated  imagery 
(CGI).  However,  current  CGI  imagery  tends  to  apear 
somewhat  cartoonish) . Several  systems  have  been  built  in 
the  past  which  use  film  (large  plates  or  strip  film)  for 
the  image  source.  A common  limitation  of  all  such  image 
sources  is  the  gaming  area  available. 

4. 9. 4. 3 Functional  Systems 

a.  Simulator  for  Air  to  Air  Combat  (syvc) . 

The  simulator  £or  air  to  air  combat  is  probably  one  of 
the  best  examples  of  the  application  of  current  tech- 
nology in  all  areas.  This  simulator  features  two  cock- 
pits, each  on  six  post  motion  systems,  each  simulating 
the  F-4  aircraft.  Each  cockpit  has  a full  instrument 
panel  with  functional  radio  aids,  radar,  and  a lead 
computing  optical  site.  G-seat  and  G-suits  are  available 
in  each  cockpit  to  supplement  the  six  degree  of  freedom 
motion  system.  Each  cockpit  is  equipped  with  a visual 
system  which  has  a field  of  view  equivalent  to  that 
available  from  the  real  aircraft.  The  display  is  com- 
prised of  eight  cathode  ray  tube  image  inputs  which  are 
merged  and  focused  at  infinity  by  an  optical  package 
called  a pancake  window.  The  system  displays  a sky, 
horizon,  checkerboard  ground  terrain,  and  a high  resolu- 
tion image  of  another  aircraft.  For  each  cockpit,  the 
other  aircraft  represents  the  adjacent  simulator  cock- 
pit? its  range,  attitude,  location,  etc.,  controlled 


195 


* 


by  the  flight  of  the  adjacent  cockpit.  The  two  cockpits 
are  linked  by  a sophisticated  computer  system.  This 
simulator  was  the  product  of  an  advanced  development  pro- 
gram at  ASD.  The  hardware  was  built  by  Singer  Simulation 
Products  Division  located  in  Binghanton,  NY.  The  hard- 
ware is  now  located  at  L\ike  AFB. 

b.  Advanced  Simulator  for  Undergraduate  Pilot 
(ASUPT) . The  ASUPT  simulator  is  a dual  cockpit  device 
developed  for  simulation  of  formation  flight  in  the  T-37 
aircraft.  It  features  two  cockpits  having  CRT/Pancake 
window  monochrome  display  systems  which  are  similar  to 
those  of  the  SAAC  system  except  that  the  ASUPT  displays 
are  larger.  The  simulator  cockpits  feature  full  cockpit 
instrumentation  for  the  T-37B,  and  six  post,  six  degree 
of  freedom  motion  systems.  The  imagery  presented  by  the 
display  is  computer  generated  and  is  limited  to  that 
which  can  be  created  with  2000  edges.  Imagery  presented 
to  the  pilot  includes  a formation  T-37's,  airfield,  run- 
way, and  generalized  terrain  areas. 

c.  Large  Amplitude  Motion  Advanced  Research 
Simulator  (LAMARS).  The  LAMARS  simulator  is  a single 
cockpit  device  which  incorporates  a wide  field  view  dome 
type  visual  display.  The  twenty  foot  diameter  dome 
viewed  by  the  pilot  from  the  cockpit  located  inside  the 
dome  displays  a featureless  sky,  featureless  terrain, 
horizon  and  a high  resolution  target  aircraft  image.  All 
imagery  is  real — projected  on  the  dome  surface.  The 
target  aircraft  projector  may  also  be  used  to  project  an 
air-to-ground  image  having  a sixty  degree  field  of  view. 
This  area  can  then  be  used  as  an  Area  of  Interest  (AOI) 
which  is  moved  about  the  total  field  of  view  of  the 
display.  The  motion  system  for  LAMARS  simulator  is 
unique — the  twenty  foot  diameter  dome  is  located  on  the 
end  of  a long  boom  and  servoed  such  that  five  degrees  of 
motion  are  available.  Wide  excursions  for  lateral  and 
vertical  motion  are  available.  Cockpit  instrumentation 
in  this  system  is  limited  to  that  of  a generalized 
aircraft.  This  simulator  was  built  by  Northrop  and  is 
currently  in  operation  at  Wright-Patterson  Air  Force  Base 
by  the  Flight  Dynamics  Laboratory. 
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MACS  III.  MACS  III  is  a dual  cockpit  air- 
to-air  combat  simulator  operated  by  the  McDonnell-Douglas 
Aircraft  Corporation.  The  system  features  two  fixed  base 
(no  motion)  40  foot  domes  onto  which  are  projected  a 
featureless  sky,  terrain,  horizon,  and  two  simultaneous 
target  aircraft  images.  The  system  is  also  capable  of 
displaying  a projected  sixty  degree  field  of  view  color 
ground  terrain  image  which  can  be  slewed  about  a limited 
area  of  the  field  of  view. 

e.  F-4E  No.  18.  F-4E  simulator  number  18  fea- 
tures a visual  system  developed  for  air-to-ground  weapons 
delivery.  The  system  consists  of  an  F-4  cockpit  with  a 
six  post  motion  system  and  a color  visual  display  having 
a field  of  view  of  approximately  120  degrees.  The 
cockpit  display  is  comprised  of  six  high  resolution  color 
television  picture  tubes  which  are  combined  and  focused 
at  infinity  by  mirror-beamsplitter  optics.  Imagery  for 
the  visual  system  is  taken  from  a terrain  model  board. 
This  system  was  an  attempt  to  incorporate  numerous 
advanced  subsystem  elements.  Difficulties  were  encoun- 
tered, primarily  in  the  area  of  the  optical  probe  (lens) 
used  with  the  television  camera  which  viewed  the  terrain 

‘model  board.  The  current  system  is  limited  by  low  image 
resolution  presented  to  the  pilot  caused  by  the  integra- 
tion of  several  marginal  components.  The  gaming  area  of 
the  terrain  model  is  also  regarded  as  inadequate  for  the 
air-to-ground  task  for  which  the  system  was  conceived. 

f . Simulator  for  Electronic  Warfare  Training 
(SEWT) . The  SEWT  simulator  is  not  a flight  simulator ; 
Roweve'r , based  on  its  applicability  to  range  simulation 
it  warrants  mention  here.  The  SEVJT  is  a multi-studeht 
station  groiind  based  training  system  controlled  by  a 
common  computer.  Each  student  station  includes  a cdl- 
lection  of  navigation  and  electronic  warfare  equipment 
as  required  to  simulate  the  EW  package  used  for  the  B-52 
and  Wild  Weasel  systems.  Students  are  presented  with 
threats  which  are  assigned  by  the  instructor.  The  stu- 
dent’s performance  in  defense  of  the  threat  is  scored 
based  on  a criteria  estciblished  by  the  instructor. 

4. 9, 4. 4 Development  Areas 

As  you  might  well  expect,  most  ongoing  simulator 
technology  development  is  directed  tov;ard  the  visual 
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area.  Requirements  for  full  mission  simulation,  wider 
fields  of  view,  color  and  higher  resolution  all  drive 
development  efforts  in  these  areas.  Efforts  are  also 
underway  to  develop  the  capability  to  simulate  airborne 
sensors  (forward  looking  infrared,  TISEO,  Low  Light 
Level  Television/LLLTV,  etc.).  Most  current  approaches 
to  this  problem  use  terrain  model  boards  viewed  by  tele- 
vision cameras.  Current  systems  such  as  the  Simulator 
for  Air-to-Air  Combat  can  be  reprogrammed  to  simulate  the 
flight  characteristics  of  other  aircraft.  Weapon  firing 
trajectories  can  be  calculated  and  hit  scoring  system 
developed  within  existing  technology.  Simulation  of  land 
and  air  based  radar  systems  is  within  the  existing 
technology.  Simulation,  as  it  exists  today,  may  be 
highly  applicable  to  the  range  pretest  task,  and  may  also 
be  considered  as  an  alternative  to  the  use  of  flight  test 
ranges  and  aircraft  for  some  test  progreims. 

4. 9. 4. 5 Relationship  of  Simulators  to  Live  Test- 

ing 


As  outlined  in  the  previous  section,  the  inventory 
of  available  simulators  is  continually  expanding.  There 
are  a nxamber  of  simulators  for  Flight  training  associated 
with  particular  types  of  aircraft,  a new  simulator  for 
air  coitisat  (SAAC)  , and  a new  simulator  for  Electronic 
Warfare  (SEWT) . There  are  also  other  simulators  which 
could  possibly  be  made  available  for  tests  and  evalua- 
tions, such  as  the  NASA  Dual  Maneuvering  Air  Combat 
Simulator  at  Langley,  Virginia,  the  Electronic  Warfare 
Environment  Simulator  (EWES)  at  General  Dynamics,  Port 
Worth,  Texas,  and  REDCAP  Electronic  Warfare  Simulator  at 
Calspan  in  Buffalo,  New  York. 

It  is  worthwhile  to  note  that  the  failure  to  prop- 
erly exploit  the  interrelationship  between  simulations 
and  operational  testing  has  been  noted  and  lamented  by  a 
nvimber  of  prominent  Defense  organizations  and  boards. 
These  include  the  USAF  Scientific  Advisory  Board  in  1966, 
the  Blue  Ribbon  Defense  Panel  in  1970,  a MITRE  study  of 
OTT&E  "Lessons  Learned"  in  1971  and  most  recently  in  a 
review  of  test  and  evaluation  conducted  for  DDR&E  by  the 
Defense  Science  Board  in  1974. 
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4. 9. 4. 6 Simulator/Live  Test  Interrelationships 

How  can  simulators  be  used  to  aid  the  design  of  live 
operational  tests?  Here  is  a list  of  some  of  the  more 
obvious  techniques. 

” Use  of  Simulators  to  Aid  Live  OT&E  Test  Design 
- Determining  sensitivity  to  instrumentation 

errors. 


- Exploring  effects  of  unavoidable  live-test 
unrealities. 


- Identifying  areas  of  greatest  information 
return  and  most  important  variables. 

- Developing  models  for  effects  of  uncontrol- 
lable variables. 

- Estimating  the  variance  of  results. 

This  list  is  certainly  not  exhaustive,  but  illus- 
trates some  of  these  points  by  reference  to  Air  Combat 
Testing.  Simulators  can  be  used  to  determine  the  sen- 
sitivity of  the  results  to  instrumentation  errors;  to 
answer  the  question,  "If  our  instrumentation  is  poor,  to 
what  extent  will  that  jeopardize  the  credibility  of  the 
results?" 


4. 9. 4. 7 Sensitivity  to  Instr\imentatlon  Errors 

With  respect  to  Air  Combat  testing,  the  ACMI,  which 
is  currently  being  acquired,  may  not  have  sufficient 
accuracy  to  warrant  the  simulation  of  gunfire  trajec- 
tories, or  for  that  matter,  the  rather  detailed  multiple- 
target  acquisition  and  resolution  problem  which  is 
intended  to  be  incorporated  in  the  missile  simulations. 
One  could  certainly  use  a simulator  to  check  a few 
situations,  one-on-one  and  two-on-one,  in  which  an 
exercise  would  be  simulated  and  the  results  tabulated  if 
there  is;  1)  No  error  in  instrumentation,  and  2)  When 
the  positional  data  and  attitude  data  is  degraded  with 
errors,  first  with  errors  which  are  inside  the  specified 
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accuracy  limits  of  the  ACMI,  and  secondly,  if  the  errors 
in  Z (vertical  component  of  position)  and  in  attitude  are 
further  degraded  outside  specification  for  ACMI,  as  some 
preliminary  indications  suggest  that  they  may  be.  The 
results  of  this  direct  comparison  of  the  same  setup  with 
and  without  errors  can  answer  that  question  --  "Will  the 
inaccuracies  of  the  ACMI  jeopardize  the  credibility  of 
the  live  test  results  or  not?" 

4. 9. 4. 8 Effects  of  Unavoidable  Live  Test  Realities 


Another  use  of  a simulator  in  the  planning  for  live 
test  is  to  explore  the  effects  of  the  unavoidable  un- 
realities of  the  real  test.  Because  of  safety  constraints, 
no  live  missiles  or  live  gunfire  are  used  in  the  current 
testing.  What  this  means  is  that  there  will  be  no  visual 
cues  of  any  missiles  in  flight  provided  either  to  the 
attacker  or  the  target,  and  there  will  be  no  tracers 
provided  to  help  a pilot  to  correct  the  trajectory  of 
his  gunfire.  It  might  be  argued  that  these  cues  are  un- 
important and  therefore  the  live  tests  will  not  be  jeo- 
pardized by  the  absence  of  these  cues.  Whether  it  is 
important  or  not  must  be  conjecture  until  it  has  been 
tested.  One  place  to  test  such  a hypothesis  is  in  a 
simulator  which  has  the  possibility  for  comparing  simular 
engagements  in  which  these  cues  are  provided  with  those 
in  which  the  cues  are  eliminated. 

4. 9. 4. 9 Areas  of  Greatest  Information  Return 

Another  use  of  simulator  in  planning  for  a live  test 
is  to  identify  those  regions  of  greatest  information 
return  for  the  resources  expended.  Regions  of  Greatest 
Information  Return;  Example;  Air  Combat  Testing. 

Problem;  US  has  no  Poxbats  against  which  to  fly  F-15, 

F-14.  Not  much  uncertainty  of  outcome  (and  thus  not  much 
information)  in  tests  of  F-14  and  F-15  vs.  F-5E.  Simu- 
lation Approach;  Validate  simulator  by  comparing  F-5E 
encounters  with  F-15,  F-14  in  simulator,  with  live  tests. 
Then;  Use  simulator  to  "fly"  F-15,  F-14  (with  various 
advanced  armament)  against  Foxbat.  We  may  look  at  this 
aspect  either  from  the  information  theory  approach  or 
simply  from  the  viewpoint  of  common  sense.  Information 
theory  tells  us  that  in  any  experiment,  the  greatest 
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information  return  occurs  when  we  have  a ipviori  uncer- 
tainty about  the  outcome.  From  a common  sense  point  of 
view  we  might  simply  note  that  if  we  can  predict  with 
high  confidence  the  outcome  of  the  experiment  in  advance, 
there ' s not  much  need  to  perfom  the  experiment  to  begin 
with.  Probably  not  meiny  readers  have  very  much  uncer- 
tainty in  their  own  minds  of  the  outcome  of  an  air  combat 
battle  which  pits  F-15s  or  F-14s  against  F-5Es.  Thus, 
the  information  return  of  such  a test  is  likely  to  be 
low.  One  of  the  objectives  of  the  current  testing  is  to 
determine  which  type  of  dogfight  missile  should  be 
procured  for  the  F-15  and  the  F-14  in  the  future.  One 
conceivable  outcome  of  the  test  is  that  either  an  F-15  or 
an  F-14  is  capable  of  shooting  down  an  F-5  with  nothing 
more  sophisticated  than  a 20mm  gun,  and  therefore, 
neither  service  needs  a new  dogfight  missile.  Obviously, 
what  is  needed  for  the  current  testing  is  a more  credible 
threat  aircraft  against  which  to  fly  the  F-14  and  F-15, 
than  the  F-5E.  The  problem,  of  course,  is  that  no  such 
threat  aircraft  is  available  in  the  United  Sates,  at 
least  not  now.  Therefore,  an  approach  to  mitigate  this- 
problem  using  a simulator  is  to  go  ahead  and  run  en- 
counters between  F-14s  and  F-5Es  and  F-15s  and  F-5Es,  and 
validate  the  credibility  of  the  simulator  by  comparing 
the  same  kind  of  tests  in  a simulator  with  those  con- 
ducted live.  Then  use  the  simulator  to  fly  those  same 
U.S.  aircraft  against  a Foxbat  or  some  other  more  credible 
and  contemporary  enemy  aircraft.  The  results  of  such  a 
test,  even  though  they  are  less  that  what  we  would 
desire,  (i.e.,  a live  test  with  credible  threat  aircraft) 
at  least  have  a better  chance  of  showing  the  requirements 
for  a dogfight  missile  than  a live  test  which  pits  the 
current  generation  of  U.S.  interceptors  against  an 
approximation  of  the  previous  generation  of  enemy  air- 
craft. 


4.9.4.10  Effects  of  Uncontrolled  Variables 


Another  use  of  simulators  is  to  estimate  the  pos- 
sible deleterious  effect  the  influence  of  vmcontrollable 
variables  introduces  in  the  live  test.  One  of  the 
problems  for  AIMVAL/ACEVAL  is  that  the  missiles  to  be 
employed  in  the  AIMVAL  test  are  prototype  research  and 
development  missiles,  for  which  no  tactics  have  been 
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developed,  taught  and  practiced  by  the  crew  which  will 
be  involved  in  the  test.  Therefore,  it  takes  very  little 
prophecy  to  suggest  that  there  will  be  a pronounced 
learning  effect  during  the  course  of  the  test,  since 
there  will  be  very  little  prior  experience  either  in  the 
tactics  which  should  be  employed  to  exploit  the  technical 
characteristics  of  these  advanced  missiles  or  in  the 
training  and  practice  of  these  tactics  after  they  have 
been  developed.  Obviously  a simulator  could  be  used  to 
familiarize  crews  with  the  technical  options  that  are 
made  available  by  the  characteristics  of  these  advanced 
missiles,  at  least  in  one-on-one  and  two-on-one  situa- 
tions. Obviously,  the  simulators  that  we  have  available 
today  (which  cannot  present  two-on-one  or  two-on-four 
situations)  will  not  be  able  to  assist  in  the  development 
of  more  complicated  tactics  which  take  advantage  of  the 
greater  numbers  of  participants.  However,  it  does  seem 
that  we  should  take  advcintage  of  the  simulators  that  are 
available  to  familiarize  the  crews  with  the  various 
technical  options,  at  least  in  the  simpler  situations  of 
these  advanced  missiles.  By  so  doing,  we  can  expect  that 
some  portion  of  the  steep  section  of  the  learning  curve 
can  occur  in  the  simulation,  rather  than  to  incur  the 
confounding  effect  of  the  total  learning  curve  during  the 
live  test. 


4.9.4.11  Conclusion 

These  examples  lead  to  the  indicated  conclusion; 
Opportunity  exists  for  better  exploitation  of  simulators 
in  the  context  of  operational  tests; 

a.  Use  simulators  to  aid  test  design. 

b.  Design  and  execute  tests  with  validation  of 
simulators  as  an  explicit  objective. 

c.  Use  validated  simulator  to  extend  test  results 
beyond  conditions  of  live  test. 

There  certainly  exists  an  opportianity  to  better 
exploit  the  simulators  that  we  have  available  to  us,  in 
the  context  of  the  relationship  to  operation  tests.  By 
that,  it  is  mean  that  1)  There  is  better  opportunity  to 
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use  simulators  in  test  design  and  test  planning,  2)  That 
tdsts  should  be  designed  and  executed  with  the  validation 
of  simulators  as  an  explicit  test  objective  in  addition 
to  those  principle  objectives  of  the  test,  in  order  that 
3)  Validated  simulator  results  may  be  used  to  extend  the 
test  results  beyond  those  conditions  which  are  possible 
in  a live  test  situation. 

4.9.5  Miscellaneous  Support  Xtems 

In  rcuige  operation  and  maintenance  substantial  sup- 
port is  available  from  other  agencies.  Further,  the 
interaction  of  range  operations  with  completely  unrelated 
activities,  particularly,  in  respect  to  environmental 
m4tters  must  be  given  full  consideration.  The  subject 
of  general  facilities,  including  those  not  directly 
related  to  the  technical  aspects  of  test  is  also  a very 
important  one.  These  items  will  be  considered  in  the 
following  subsections. 

4. 9. 5.1  Radar  Emission  Spectrum  and  Antenna 
Measurements 


4 . 9 . 5 . 1 . 1  General 


The  objective  of  Electromagnetic  Qualification 
measurement  field  support  is  to  provide  the  Air  Force  and 
other  DOD  and  government  agencies  the  capability  of 
accurately  determining  the  actual  electromagnetic  char- 
acteristics of  any  given  radar  system  under  operational 
conditions.  Utilizing  the  RATSCAT  (Radar  Target  Scatter 
Division)  at  Holloman  AFB,  New  Mexico,  the  user  and/or 
developing  agencies  can  obtain  an  independent  Air  Force 
assessment  of  contractor  delivered  equipment  and  its 
operation  and  maintenance. 

4. 9. 5. 1.2  Requirements 

The  data  collection  requirement  for  field  measure- 
ment support  is  the  provision  to  range  operators  of  a 
capability  not  found  in-house  to  maintain;  validate  and 
calibrate  electromagnetic  radiating  equipment.  Data  col- 
lected may  also  be  used  for  electromagnetic  compatibility 
assessments,  intelligence  validations,  maintenance  data 
base  generation,  and  bench  O&M  justifications. 
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4. 9. 5. 1.3  Data  Collection  Parameters 


Equipment  data  collection  parameters  and  techniques 
are  described  in  MIL-STD-449D,  and  in  general,  include: 

a.  Time,  waveform  and  RF  power. 

b.  Conducted  emission  spectrum. 

c.  Radiated  emission  spectrum. 

d.  Antenna  patterns. 

e.  Receiver  sensitivity  parameters. 

These  parameters  may  be  varied  depending  upon  field 
measurement  requirements. 

4. 9. 5. 1.4  Recommendations 

The  Radar  Target  Scatter  Division  CRATSCAT)  at 
Holloman  AFB,  New  Mexico,  has  a proven  capability  to 
conduct  the  measurements  program  at  OTT&E  ranges. 

Support  required  should  be  planned  and  coordinated  with 
RATSCAT  well  in  advance  so  contract,  equipment,  and 
personnel  actions  can  be  taken  in  a timely  manner.  The 
assessment  data  closes  the  gap  between  radar  designers, 
developers,  and  users.  The  field  measurements  program 
also  identifies  deficiencies  in  radar  technical  manuals. 

4. 9. 5. 2 Air  Traffic  Control  and  Air  Space  Manage- 
ment 

Air  Traffic  Control  services  for  aircraft  on  USAF 
gunnery,  weapons  and  test  ranges  are  a fairly  new 
concept  to  the  managers  of  USAF  Air  Traffic  Control 
Resources  (Air  Force  Communications  Service) . Air 
Traffic  Control  or  the  control  of  aircraft  traveling  to 
and  from  ranges  gained  impetus  in  the  last  five  years  as 
mandatory  Instrument  Flight  Rules  (IFR)  flights  became 
a way  of  life  in  the  Air  Force.  Tied  to  this  was  the 
rapid  growth  of  Civil/General  aviation  and  the  need  for 
more  freedom  of  movement  in  the  already  greatly  re- 
stricted airspace  for  the  civil  user  and  a requirement 


for  a larger  portion  of  the  airspace  for  the  testing  and 
development  of  new  weapons  systems  for  the  Department  of 
Defense. 

Numerous'  attempts  have  been  made  by  the  Air  Force 
to  make  better  use  of  the  airspace  they  already  control 
on  a part  time  or  full  time  basis  by  taking  formerly 
Restricted  Airspace  and  converting  it  to  Joint  use 
airspace  for  better  utilization  by  all  civil  and  militairy 
users. 


4. 9. 5. 2.1  Basic  Considerations 


a.  Airspace  requirements  and  current  Air  Traffic 
density  should  be  properly  considered  when  a new  range 
location  is  picked  or  existing  range  capabilities  are 
increased.  Safety  and  environmental  considerations 
associated  with  airspace  use  should  be  major  inputs 
prior  to  any  major  decisions  or  new  reinge  locations  or 
improvements  to  existing  ranges. 

b.  Once  a range  is  established  and  it  is  deter- 
mined that  Air  Traffic  Control  Services  are  desired  or 
required  the  controlling  agency  must  check  for  conflicts 
with  other  air  traffic;  i.e..  General  Aviation  Flyways, 
Airways,  Airports,  Low  Altitude-High  Speed  Routes, 
Airstrips  (private),  and  other  possible  constraints 

:to  determine  what  Air  Traffic  service  would  do  to  these 
users. 


c.  Equipment  is  required  to  ehhance  the  joint 
use  of  airspace;  proper  radar  coverage;  adequate  radios; 
landline  communications;  and  properly  trained  Air 
Traffic  Controllers  along  with  the  facilities  in  whiOh 
to  locate  the  men  and  equipment.  These  resources  should 
be  included  in  the  long  term  planning,  programming  and 
budgeting  cycle . 


4. 9. 5. 2. 2 Operations 

In  the  interest  of  realism  and  as  safety  permits, 
mission  aircraft,  once  on  the  range,  will  be  allowed 
maximum  freedom  of  movement  to  complete  the  mission.  In 
this  respect  the  Air  Traffic  Control  facility  will  be 
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required  to  work  closely  with  the  iticinager  of  the  rcinge 
in  mission  scheduling  so  no  one  portion  of  the  range 
has  conflicts  or  saturation  while  other  segments  are 
not  being  used.  In  addition  to  the  range  users  require- 
ments in  scheduling,  consideration  must  be  given  to  the 
civil  users'  needs  and  above  all,  the  reason  for  Air 
Traffic  Control,  safety  of  all  users. 

4. 9. 5. 2. 3 Coordinating  Agencies 

The  agencies  listed  below  are  involved  in  airspace 
and  air  traffic  management  and  can  provide  Air  Traffic 
Service  to  his  operation. 

a.  Headquarters  Air  Force  Communications  Service/ 
DCS  Flight  and  Airspace  Management. 

b.  HQ  USAF/XOOF 

c.  The  Air  Force  Representative  at  the  nearest 
FAA  Region  (this  officer  is  a member  of  the  Air  Staff 
(XOOF) ) . 

d.  DOD  Flight  Information  Publication  (FLIP) , 

Area  Planning  Special  Use  Air  Space. 

4. 9. 5. 3 Weather  Prediction  Use 

Staff  meteorological  support  is  provided  to  AFSC 
ranges  by  the  6th  Weather  Wing,  with  headquarters  at 
Andrews  AFB,  Maryland.  Supporting  the  range  detachment 
is  the  Environmental  Tactical  Applications  Center 
(ETAC) , which  is  a studies  and  analysis  center  located 
in  Asheville,  North  Carolina,  and  in  the  Washington 
Naval  Yard.  Another  important  source  of  environmental 
data  is  the  Cambridge  Research  Laboratory,  if  a staff 
meteorologist  cannot  solve  a problem,  an  analysis  will  be 
performed  by  one  of  these  two  organizations. 

4. 9. 5. 3.1  Meteorological  Impact 

Since  clouds  cover  about  50%  of  the  world  at  any 
given  moment,  they  represent  the  most  significant  mete- 
orological impact  on  range  operation.  Severe  weather 


phenomena  are  more  easily  recognized  and  range  opera- 
tions curtailed!  accordingly.  Clouds  in  general,  however 
can  impact  range  operations  by  restricting  visibility 
(visual),  radar  electro-optics,  infrared),  limiting 
flying  operations  (turbulence,  rain,  icing),  and  dis- 
rupting communications  (lightning,  spacious  deflections) 

4 . 9 . 5 . 3 . 2 Forecast  Usage 

A study  done  by  the  systems  command  at  ESD  called 
Wfeather  85  proposed  three  approaches  to  weather  prob- 
lems. 1)  Engineer  it  out  and  achieve  a truly  all 
wfeather  Air  Force.  2)  Modify  the  weather.  3)  Improve 
the  use  of  weather  information.  The  first  is  probably 
a physical  impossibility.  The  laws  in  physics  would 
have  to  be  changed  to  do  some  of  the  things  necessary 
to  call  a weapon  "all-weather.”  In  weather  modifica- 
tion, there  is  good  progress  in  cold  fog  dissipation. 
There  is  now  an  effort  underway  at  CKL  for  a new  warm 
fog  dissipation  system.  It  also  has  promise  in  weather 
modification,  however,  it  takes  a particular  kind  of 
situation  that  is  amenable  to  modifications.  The  third 
possibility  - improve  the  use  of  weather  information,  is 
an  area  in  which  prograim  can  be  made  with  present  tech- 
nology. Figure  4-42  shows  the  deterioration  of  a for^.- 
cast  over  time.  It  shows  that  a weather  observation  is 
perfect  and  that  is  is  approximately  true  (99.5%  level). 
In  this  time  period  (high  side  of  the  curve) , something 
like  0 to  20  minutes,  the  forecaster  is  generaly  ac- 
curate. Out  in  the  24  to  36  hour  time  period,  he  is  hot 
so  good.  To  improve  the  use  of  weather  information  in 
decision  making,  compress  the  time  of  decision  — "Time 
of  Weather  Observation  and  Time  of  the  Forecast."  Along 
this  curve  to  the  left,  is  the  engineering  approach. 

It  is  contrasted  to  the  scientific  approach  in  the  verti 
cal.  Improve  meteorology,  or  raise  this  curve  in  the 
vertical,  by  improving  the  state-of-the-art.  This  is 
what  the  Cambridge  Research  Laboratory  has  been  con- 
centrating on  for  years.  The  engineering  approach  is 
known  as  time  compression.  To  complement  that,  to  make 
sure  the  data  is  available  that  is  necessary  to  give 
the  decision  maker  what  he  needs,  there  must  be  another 
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kind  of  infomation  - known  as  the  operating  character- 
istics. Figuire  4-43  shows  in  terms  of  cost  and  prob- 
ability of  success  in  any  given  event.  What  happens 
without  weather  information  or  climatology  is  shown  by 
the  No  Weather  Information  line.  If  the  operating  char- 
acteristics are  known,  we  can  calculate  by  observing  test 
characteristics  in  the  environment  and  present  to  a com- 
mander, the  decision  maker,  numbers  that  say  if  willing 
to  commit  (for  example)  on  a 70%  threshold,  then  over  a 
long  period  of  time  he  will  succeed  about  50%.  If  not> 
then  on  the  no-weather  curve,  the  cost  will  increase  by 
about  a factor  or  two  and  probability  of  success  over 
a longer  period  of  time  will  be  degraded. 

To  develop  decision  algorithms  that  integrate  prob- 
ability of  success  with  other  data  that  helps  a commander 
make  a decision,  we  need  to  know  Cfor  a tactical  scenario) 
the  target,  the  base  location,  characteristics,  the 
degree  of  difficulty,  and  the  priority.  We  know  the 
resources,  such  as  aircraft,  weapon  mis,  pilot,  that  sort 
of  thing.  Marry  this  with  the  probability  of  success 
indicator  that  can  be  provided  by  developing  the  oper- 
ating characteristics  and  you  then  have  potentially  a 
closed  system  that  will  match  the  weather,  probability  of 
success,  target,  aircraft,  weapon,  tactic  or  anything 
else  you  want.  To  do  that  job  are  two  key  needs  the 
necessary  data,  and  a command  and  control  system  to  put 
it  in.  Ceiling  and  visibility  are  not  the  only  problem  in 
solving  a target  acquisition  problem  for  a precision 
guided  munition.  There  are  other  things,  like  target 
contrast,  time  of  day,  reflectance,  for  which  there  are 
no  measurements  taken  today.  In  a case  of  war,  the 
only  weather  data  is  ceiling  and  visibility.  What  are 
needed  are  the  empiricims  that  if  clouds  and  visibility 
under  certain  air  mass  conditions  are  known,  an  inference 
can  be  made  of  probability  of  success  by  knowing  the 
operating  characteristics  of  the  weapon. 

A second  need  is  a better  emphasis  on  command  and 
control,  that  is,  compressing  the  time  from  which  data 
are  gathered  and  the  time  when  the  decision  is  made. 

That  doesn't  only  apply  to  weather  data,  but  to  intel- 
ligence, logistics,  personnel,  or  anything  else,  when 
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working  in  a time  sensitive  environment,  with  some  of 
the  things  that  are  envisioned  in  WWMCCS  and  485L. 

Any  data  that  are  perishable  and  need  to  be  compressed 
will  require  automation,  computer  transmission  of  data 
and  the  integration  into  the  decision  algorithm. 

4. 9. 5. 3. 3 Recontmended  Weather  Instrumentation 
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4 . 9 . 5 . 4 Environmental  Statement  CBS) 

An  environmental  assessment  must  be  made  for  the 
overall  range  operation  and  include  foreseen  improve- 
dxients  and  an  environmental  statement  prepared  and  filed 
if  required.  Other  agencies  and  appropriate  contractors 
should  be  tasked  for  technical  support  as  required. 

After  filing  the  initial  ES  with  the  Council  on  En- 
.vironmental  Quality  (CEQ) , update  assessments  must  be 
made  and  statements  filed,  where  required,  not  less 
than  annually  during  range  development.  Notwithstand- 
ing, the  environmental  consequences  of  any  proposed 
action  will  be  assessed  at  the  earliest  practical  stage 
in  the  plcinning  process,  and  in  all  instances  prior 
to  decision.  Environmental  assessments  and  statements 
(updates)  will  be  prepared  in  accordance  with  guidelines 
issued  by  HQ  USAF  and  the  latest  Federal  Regulation. 

The  environmental  statement  should  include  a detailed 
description  of  the  proposed  action,  the  relationship  of 
the  proposed  action  to  existing  land  use  plans  and 
policies,  probable  impacts  of  the  proposed  action?  and 
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alternatives  to  the  proposed  action.  The  Environmental 
Statement  for  Proposed  Continental  Operations  Range 
dated  17  December  1974  is  a very  extensive  and  thorough 
statement  and  could  be  used  as  a guide. 

4. 9. 5. 5 Facilities 

Since  facilities  are  a long-lead  item,  it  is  very 
important  that  the  requirements  be  determined  and  the 
programming  started  early. 

4. 9. 5. 5.1  Civil  Engineering  Concept 

Civil  Engineering  methods  and  procedures  to  be 
implemented  during  development,  acquisition  and  follow- 
on  maintenance  of  a range  are  discussed  in  this  section. 
Facilities  to  include  utilities  support  are  long  lead 
items.  They  can  be  obtained  in  several  ways  with  both 
type  of  work  and  dollar  cost  critical  to  funding  cate- 
gory and  lead  time.  Also,  real  estate  rights  and  en- 
vironmental effects  are  key  factors  and  must  be  con- 
sidered and  resolved  at  the  earliest  practical  stage 
in  the  planning  process.  The  Base  Civil  Engineer  (BCE) 
with  the  real  estate  records  for  the  range  is  nomally 
the  focal  point  for  all  Civil  Engineering  actions.  BCE 
procedures  are  prescribed  and  the  range  is  normally  a 
remote  portion  of  his  primary  base  workload. 

a.  Operational  Facility  Concept.  It  is  to  be 
anticipated  that  range  development  or  improvement  will 
jointly  use  facilities  servicing  other  systems.  Maximum 
utilization  of  existing  facilities  must  be  made.  Facil- 
ities required  are  those  necessary  to  support,  house, 
store  and  secure  system,  equipment  and  personnel  require- 
ments. Emphasis  should  focus  on  equipment  mobility 
whenever  mission  requirements  can  be  met  cost  effec- 
tively. 


b.  Management  Concept.  As  facility  requirements 
are  validated,  it  is  necessary  to  fund  these  projects 
using  O&M  minor  construction  funds,  emergency  or  routine 
Military  Construction  Program  (MCP)  funds,  emergency 
minor  construction  (P-341)  funds,  or  RDT&E  funds  (AFR 
80-22)  dependent  upon  lead  time.  Preparation  of  program- 
ming documentation  will  be  accomplished  through  the  Base 
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Civil  Engineer  in  accordance  with  AFM  86-1,  Programming 
Civil  Engineer  Resources,  and  related  Air  Force/Service 
policies.  A separate  range  Facilities  Working  Group 
(FWG)  should  be  established  and  chaired  by  a range 
representative.  This  FWG  will  provide  scoping  reviews, 
review  facility  programming  actions,  and  act  as  a facil- 
ities coordinating  group  and  sounding  board  for  all  range 
facility  actions  and  recommend  to  the  Base  Facilities 
Board.  Standard  Air  Force  facility  CAFM  88-2,  Definition 
of  Air  Force  Structures)  or  Bare  Base  System  Segment 
Designs  should  be  used  to  the  greatest  extent  possible ; 
Facility  alteration  or  construction  projects  will  be 
designed  in  accordance  with  applicable  Air  Force/Host 
Commeind  policies;  e.g.,  AFM  88-15,  Air  Force  Design 
Manual  Criteria  and  Standard  of  Air  Force  Construction, 
etc.  Facility  alteration  or  construction  projects  will 
be  executed  by  the  designated  agency— Army  Corps  of 
Engineers,  Navy  Facilities  Engineering  Command,  Air  Force 
Major  Air  Command,  or  local  Base  Civil  Engineer.  Real 
property  facilities  may  be  used  by  Air  Force  personnel 
prior  to  final  completion  in  accordance  with  AFR  85-17, 
Beneficial  Occupancy.  Final  acceptance  and  transfer  of 
real  property  will  be  accomplished  in  accordance  with  AFR 
88-9,  Transfer  and  Acceptance  of  Facilities  Constructed 
for  the  Air  Force.  Normal  maintenance  functions  are 
funded  and  performed  by  the  local  Base  Civil  Engineer 
starting  at  the  fime  of  Air  Force  beneficial  occupancy  of 
the  facility.  When  another  command  (e.g.,  AFSC)  becomes 
an  interim  user  of  the  real  property  pending  installation 
of  system  equipment,  facility  repair,  and  normal  main- 
tenance or  modification  will  be  arranged  for  through  the 
Base  Civil  Engineer.  Facility  maintenance  practices 
required  for  facilities  determined  to  be  \inique  or  to 
contain  complex  facility  subsystems  will  be  formulated  by 
a range  operator  and  approved  by  the  Facilities  Working 
Group . 


c.  Range  Facility  Master  Plan.  A Range  Facility 
Master  Plan  should  be  prepared  and  maintained  for  the 
range  as  part  of  the  Civil  Engineering  Plan  in  coordina- 
tion with  the  BCE. 
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4. 9. 5. 6 Mapping/  Charting  and  Geodesy  CMC&G) 

MC&G  products  include  maps,  charts,  target  materials, 
digital  terrain  and  point  positioning  data  bases,  radar 
simulation  plates  and  data  files,  correlation  matrices 
and  geophysical  data.  Services  include  evaluation  of 
the  above  data,  geodetic  positioning,  instrumentation 
calibration,  positioning  and  related  activities.  Detailed 
descriptions  and  procedures  for  obtaining  support  are 
contained  in  AFR  96-9. 

Long  range  planning  and  progrcimming  for  use  of 
required  Defense  Mapping  Agency  resources  are  required. 

DMA  offices  are  DMA-AC,  St  Louis  AF  Station,  St  Louis, 
Missouri  63118  and  DMA-AC,  F.  E.  Warren  AFB,  Wyoming 
82001.  The  DMA-AC/PR  Air  Force  contact  is  currently 
Major  Frank  Hotter,  St  Louis  AFS,  Missouri  63118,  AV 
698-4871. 
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